00010000:00010000:0.0F:1788930145.630380:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1788930145.764476:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930145.764544:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930145.764572:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930145.764592:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930145.764611:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930145.764629:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930145.764655:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930145.764685:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747141632 00000100:00100000:2.0:1788930145.764696:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747141632 00000100:00100000:2.0:1788930145.764763:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747142016 00000100:00100000:2.0:1788930145.764766:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747142016 00000100:00100000:2.0:1788930145.764795:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 35 00000100:00100000:3.0F:1788930145.764962:0:16618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747141888 00000100:00100000:3.0:1788930145.764974:0:16618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747141888 00000100:00100000:3.0:1788930145.764996:0:16618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747141760 00000100:00100000:3.0:1788930145.764998:0:16618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747141760 00000100:00100000:3.0:1788930145.765008:0:16618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747142144 00000100:00100000:3.0:1788930145.765010:0:16618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747142144 00000100:00100000:3.0:1788930145.765020:0:16618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747142272 00000100:00100000:3.0:1788930145.765022:0:16618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747142272 00000100:00100000:3.0:1788930145.765035:0:16618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 23 00000100:00100000:3.0:1788930145.765043:0:16618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+9:2361:x1875828747141760:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930145.765148:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+24:2361:x1875828747141632:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788930145.772441:0:16618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+9:2361:x1875828747141760:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 7385us (7834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930145.772456:0:16618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 23 00000100:00100000:3.0:1788930145.772553:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 22 00000100:00100000:3.0:1788930145.772570:0:15108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb42ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+5:2358:x1875828747141888:12345-192.168.204.40@tcp:9:kworker.0 00000020:00000080:3.0:1788930145.772602:0:15108:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237dcc0 00000100:00080000:3.0:1788930145.772620:0:15108:0:(import.c:65:import_set_state_nolock()) ffff8d2d849fc000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788930145.772663:0:15108:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788930145.774109:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+24:2361:x1875828747141632:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 8955us (9553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930145.774124:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 35 00000100:00100000:2.0:1788930145.774182:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 23 00000100:00100000:2.0:1788930145.774198:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+5:2358:x1875828747142144:12345-192.168.204.40@tcp:9:kworker.0 00000020:00000080:2.0:1788930145.774239:0:15106:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237dcf1 00000100:00080000:2.0:1788930145.774260:0:15106:0:(import.c:65:import_set_state_nolock()) ffff8d2ebefd4800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788930145.774298:0:15106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:2.0:1788930145.774469:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+2:2358:x1875828747142144:12345-192.168.204.40@tcp:9:kworker.0 Request processed in 278us (9837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930145.774477:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 23 00000100:00100000:2.0:1788930145.774493:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 24 00000100:00100000:2.0:1788930145.774501:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+5:2358:x1875828747142272:12345-192.168.204.40@tcp:9:kworker.0 00000020:00000080:2.0:1788930145.774515:0:15106:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237dcf8 00000100:00080000:2.0:1788930145.774532:0:15106:0:(import.c:65:import_set_state_nolock()) ffff8d2ebefd2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788930145.774548:0:15106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788930145.774633:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6f457351-9f47-4d69-8728-cf079fbb04a5+2:2358:x1875828747142272:12345-192.168.204.40@tcp:9:kworker.0 Request processed in 132us (9976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930145.774640:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 24 00000100:00080000:2.0:1788930145.774659:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788930145.774663:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788930145.774666:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788930145.774680:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 36 00000100:00100000:2.0:1788930145.774689:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f457351-9f47-4d69-8728-cf079fbb04a5+6:2361:x1875828747142016:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930145.774720:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6f457351-9f47-4d69-8728-cf079fbb04a5+6:2361:x1875828747142016:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 32us (10108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930145.774726:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 36 00000100:00100000:2.0:1788930145.774821:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747141504 00000100:00100000:2.0:1788930145.774828:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747141504 00000100:00100000:2.0:1788930145.774863:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 125 00000100:00100000:2.0:1788930145.774871:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e91369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:2361:x1875828747141504:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930145.774897:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e91369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:2361:x1875828747141504:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 27us (10324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930145.774903:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 125 00010000:00010000:2.0:1788930145.775070:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788930145.782086:0:15108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb42ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+2:2358:x1875828747141888:12345-192.168.204.40@tcp:9:kworker.0 Request processed in 9509us (17606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930145.782103:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 22 00010000:00010000:3.0:1788930145.782401:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788930146.388006:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934634 is committed 00000020:00080000:2.0:1788930146.388037:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d2e915e8000 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:2.0:1788930146.388043:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2ebc5c3700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d2e915e8540 00000020:00080000:2.0:1788930146.388047:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d2ebc5c3800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d2d86743400 00000001:00080000:2.0:1788930146.388065:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:3.0:1788930146.395732:0:14460:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:3.0:1788930146.396052:0:14460:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:1.0F:1788930146.404073:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:1.0:1788930146.404372:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00100000:1.0:1788930146.404479:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6f457351-9f47-4d69-8728-cf079fbb04a5 00000020:00000080:1.0:1788930146.404484:0:6716:0:(genops.c:885:class_export_put()) final put ffff8d2ebefd1000/6f457351-9f47-4d69-8728-cf079fbb04a5 00000001:00080000:1.0:1788930146.404505:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000020:00000080:3.0:1788930146.404543:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2ebefd1000/6f457351-9f47-4d69-8728-cf079fbb04a5 for lustre-OST0000 00000020:00000080:3.0:1788930146.404748:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2ebefd4800 for lustre-OST0000 00010000:00010000:1.0:1788930146.651792:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930147.291444:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788930147.291469:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770192384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788930147.291541:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930147.291698:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770192384 00000100:00100000:1.0:1788930147.291708:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770192384 00000100:00100000:1.0:1788930147.291776:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788930147.291793:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770192384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788930147.291841:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788930147.291891:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770192384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930147.291899:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788930147.291987:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770192384:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788930147.292151:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788930147.292426:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770192640:0@lo:400:kworker.0 00000100:00100000:2.0:1788930147.292461:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930147.292484:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788930147.292489:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770192768:0@lo:400:kworker.0 00000100:00100000:2.0:1788930147.292513:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930147.292541:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770192640 00000100:00100000:2.0:1788930147.292547:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770192640 00000100:00100000:2.0:1788930147.292582:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788930147.292591:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770192640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930147.292630:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770192640:12345-0@lo:400:kworker.0 Request processed in 41us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930147.292637:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788930147.292657:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770192768 00000100:00100000:2.0:1788930147.292660:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770192768 00000100:00100000:2.0:1788930147.292688:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788930147.292695:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770192768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930147.292726:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770192768:12345-0@lo:400:kworker.0 Request processed in 32us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930147.292732:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788930147.292752:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788930147.292771:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770192768:0@lo:400:kworker.0 00000100:00100000:2.0:1788930147.292780:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1788930147.292785:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2eb597f100, transno 8589934595 00000100:00100000:0.0:1788930147.293064:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3309:1875828770192512:0@lo:400:kworker.0 00000100:00100000:0.0:1788930147.293112:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930147.293140:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770193024:0@lo:400:kworker.0 00000100:00100000:0.0:1788930147.293162:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930147.293181:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788930147.293186:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875828770192896:0@lo:400:kworker.0 00000100:00100000:0.0:1788930147.293206:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930147.293254:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770192512 00000100:00100000:0.0:1788930147.293259:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770192512 00000100:00100000:0.0:1788930147.293289:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788930147.293295:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9136b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3309:x1875828770192512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930147.293331:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9136b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3309:x1875828770192512:12345-0@lo:400:kworker.0 Request processed in 36us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930147.293338:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788930147.293377:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3309:1875828770192512:0@lo:400:kworker.0 00000004:00080000:2.0:1788930147.293813:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1788930147.293838:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770192640:0@lo:400:kworker.0 00000100:00100000:2.0:1788930147.294471:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770193024 00000100:00100000:2.0:1788930147.294487:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770193024 00000100:00100000:2.0:1788930147.294540:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770192896 00000100:00100000:2.0:1788930147.294544:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770192896 00000100:00100000:2.0:1788930147.294575:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788930147.294583:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770193024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930147.294655:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875828770193024:12345-0@lo:400:kworker.0 Request processed in 73us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930147.294663:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788930147.294678:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788930147.294683:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875828770192896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930147.294711:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875828770192896:12345-0@lo:400:kworker.0 Request processed in 28us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930147.294717:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788930147.294766:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875828770192896:0@lo:400:kworker.0 00000100:00100000:2.0:1788930147.294776:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875828770193024:0@lo:400:kworker.0 00000100:00080000:1.0:1788930147.294905:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788930147.677428:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788930147.915327:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6f457351-9f47-4d69-8728-cf079fbb04a5 00000020:00000080:3.0:1788930147.915337:0:7639:0:(genops.c:885:class_export_put()) final put ffff8d2ebefd0000/6f457351-9f47-4d69-8728-cf079fbb04a5 00000001:00100000:3.0:1788930147.915368:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0f2435a2-1693-4ef4-8931-95da2710cab3 00000020:00000080:3.0:1788930147.915371:0:7639:0:(genops.c:885:class_export_put()) final put ffff8d2d849ff000/0f2435a2-1693-4ef4-8931-95da2710cab3 00000020:00000080:3.0:1788930147.915386:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2ebefd0000/6f457351-9f47-4d69-8728-cf079fbb04a5 for lustre-OST0001 00000020:00000080:3.0:1788930147.915428:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d849ff000/0f2435a2-1693-4ef4-8931-95da2710cab3 for lustre-OST0001 00000020:00000080:3.0:1788930147.915450:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2ebefd2000 for lustre-OST0001 00000020:00000080:3.0:1788930147.915458:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2d849fc000 for lustre-OST0001 00000100:00100000:3.0:1788930148.217504:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930148.224881:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747142400 00000100:00100000:0.0:1788930148.224898:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747142400 00000100:00100000:1.0:1788930148.227554:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 63 00000100:00100000:1.0:1788930148.227579:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+11:14429:x1875828747142400:12345-192.168.204.40@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788930148.227711:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+11:14429:x1875828747142400:12345-192.168.204.40@tcp:60:lhsmtool_posix.0 Request processed in 144us (10219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930148.227719:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 63 00000100:00080000:0.0:1788930148.228657:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788930148.244213:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930148.245097:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747142656 00000100:00100000:3.0:1788930148.245111:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747142656 00000100:00100000:3.0:1788930148.245172:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 16 00000100:00100000:3.0:1788930148.245183:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e83ca0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+11:14429:x1875828747142656:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788930148.245475:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e83ca0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+12:14429:x1875828747142656:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 Request processed in 292us (1281us total) trans 8589934636 rc 0/0 00000100:00100000:3.0:1788930148.245484:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 16 00010000:00010000:1.0:1788930148.699916:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930149.339622:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788930149.345147:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e862c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770193152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788930149.345251:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930149.345368:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770193152 00000100:00100000:3.0:1788930149.345379:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770193152 00000100:00100000:3.0:1788930149.345456:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788930149.345474:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770193152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788930149.345527:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788930149.345581:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770193152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930149.345588:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788930149.345878:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788930149.347637:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e862c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770193152:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788930149.724369:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930150.752265:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930150.877220:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930150.877290:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930150.877324:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930150.877351:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930150.877379:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747142784 00000100:00100000:0.0:1788930150.877387:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747142784 00000100:00100000:0.0:1788930150.877436:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 127 00000100:00100000:0.0:1788930150.877445:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e91369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:2362:x1875828747142784:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788930150.877508:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e91369450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:2362:x1875828747142784:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 63us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930150.877520:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 127 00000100:00100000:0.0:1788930150.877557:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747142912 00000100:00100000:0.0:1788930150.877561:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747142912 00000100:00100000:0.0:1788930150.877603:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747143168 00000100:00100000:0.0:1788930150.877606:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747143168 00000100:00100000:0.0:1788930150.877627:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 40 00000100:00100000:0.0:1788930150.877634:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+12:2362:x1875828747142912:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788930150.877671:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+12:2362:x1875828747142912:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 38us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930150.877676:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 40 00000100:00100000:0.0:1788930150.877689:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 41 00000100:00100000:0.0:1788930150.877694:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f457351-9f47-4d69-8728-cf079fbb04a5+6:2362:x1875828747143168:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788930150.877716:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f457351-9f47-4d69-8728-cf079fbb04a5+6:2362:x1875828747143168:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 22us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930150.877722:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 41 00000100:00080000:0.0:1788930150.877845:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788930150.878275:0:16618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747143040 00000100:00100000:3.0:1788930150.878282:0:16618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747143040 00000100:00100000:3.0:1788930150.878333:0:16618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 25 00000100:00100000:3.0:1788930150.878342:0:16618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2362:x1875828747143040:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788930150.878404:0:16618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2362:x1875828747143040:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 63us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930150.878411:0:16618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 25 00000100:00080000:0.0:1788930150.878656:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788930151.444336:0:16656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:0.0:1788930151.444363:0:16656:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967527 batchid updated 00000020:00080000:3.0:1788930151.446002:0:14460:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000020:00080000:3.0:1788930151.446018:0:14460:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000040:00080000:3.0:1788930151.586488:0:14457:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788930151.586499:0:14457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788930151.586537:0:14457:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788930151.586543:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788930151.772192:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930152.411544:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788930152.411567:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770193280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788930152.411640:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930152.411856:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770193280 00000100:00100000:3.0:1788930152.411865:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770193280 00000100:00100000:3.0:1788930152.411942:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788930152.411952:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770193280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788930152.411989:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788930152.412049:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770193280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930152.412056:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788930152.412114:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770193280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788930152.412330:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770193664:0@lo:400:kworker.0 00000100:00100000:1.0:1788930152.412363:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930152.412390:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788930152.412395:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770193792:0@lo:400:kworker.0 00000100:00100000:1.0:1788930152.412416:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930152.412440:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770193664 00000100:00100000:1.0:1788930152.412444:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770193664 00000100:00100000:1.0:1788930152.412485:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770193792 00000100:00100000:1.0:1788930152.412489:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770193792 00000100:00100000:1.0:1788930152.412510:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788930152.412517:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770193664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930152.412554:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770193664:12345-0@lo:400:kworker.0 Request processed in 38us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930152.412561:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788930152.412578:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788930152.412585:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770193792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930152.412608:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770193792:12345-0@lo:400:kworker.0 Request processed in 25us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930152.412614:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788930152.412645:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770193792:0@lo:400:kworker.0 00000100:00100000:1.0:1788930152.412653:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770193664:0@lo:400:kworker.0 00000100:00100000:2.0:1788930152.412765:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3308:1875828770193408:0@lo:400:kworker.0 00000100:00100000:2.0:1788930152.412799:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930152.412831:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770193920:0@lo:400:kworker.0 00000100:00100000:2.0:1788930152.412853:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930152.412869:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788930152.412874:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770193536:0@lo:400:kworker.0 00000100:00100000:2.0:1788930152.412896:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930152.412920:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770193536 00000100:00100000:2.0:1788930152.412924:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770193536 00000100:00100000:2.0:1788930152.412955:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788930152.412963:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770193536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930152.413022:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770193536:12345-0@lo:400:kworker.0 Request processed in 61us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930152.413029:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788930152.413057:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770193536:0@lo:400:kworker.0 00000100:00100000:2.0:1788930152.413074:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770193920 00000100:00100000:2.0:1788930152.413076:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770193920 00000100:00100000:2.0:1788930152.413097:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788930152.413102:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770193920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930152.413128:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770193920:12345-0@lo:400:kworker.0 Request processed in 26us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930152.413134:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788930152.413153:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770193920:0@lo:400:kworker.0 00000100:00080000:0.0:1788930152.413556:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788930152.413562:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788930152.413564:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788930152.413639:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770193408 00000100:00100000:1.0:1788930152.413644:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770193408 00000100:00100000:1.0:1788930152.413678:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788930152.413684:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebe0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3308:x1875828770193408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930152.413724:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebe0fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3308:x1875828770193408:12345-0@lo:400:kworker.0 Request processed in 40us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930152.413737:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788930152.413813:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3308:1875828770193408:0@lo:400:kworker.0 00010000:00010000:0.0:1788930152.808566:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930153.820020:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788930154.462581:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770194048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788930154.462655:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930154.462735:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770194048 00000100:00100000:3.0:1788930154.462744:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770194048 00000100:00100000:3.0:1788930154.462805:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788930154.462827:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770194048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788930154.463543:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788930154.463623:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770194048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 797us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930154.463652:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788930154.463686:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788930154.463732:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770194048:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788930154.844398:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930155.870456:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930155.996377:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930155.996422:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930155.996447:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930155.996468:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930155.996495:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747143552 00000100:00100000:0.0:1788930155.996504:0:15108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747143552 00000100:00100000:0.0:1788930155.996566:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 27 00000100:00100000:0.0:1788930155.996576:0:15108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2359:x1875828747143552:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788930155.996650:0:15108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2359:x1875828747143552:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930155.996658:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 27 00000100:00100000:0.0:1788930155.996680:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747143424 00000100:00100000:0.0:1788930155.996684:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747143424 00000100:00100000:0.0:1788930155.996707:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747143680 00000100:00100000:0.0:1788930155.996710:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747143680 00000100:00100000:0.0:1788930155.996728:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 45 00000100:00100000:0.0:1788930155.996734:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+11:2359:x1875828747143424:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788930155.996771:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f2435a2-1693-4ef4-8931-95da2710cab3+11:2359:x1875828747143424:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 37us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930155.996778:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 45 00000100:00100000:0.0:1788930155.996791:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 46 00000100:00100000:0.0:1788930155.996796:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+6:2359:x1875828747143680:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788930155.996817:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+6:2359:x1875828747143680:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 21us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930155.996822:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 46 00000100:00080000:0.0:1788930155.996841:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788930155.996845:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788930155.998019:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747143296 00000100:00100000:2.0:1788930155.998029:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747143296 00000100:00100000:2.0:1788930155.998077:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 129 00000100:00100000:2.0:1788930155.998087:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5436c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:2359:x1875828747143296:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930155.998140:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5436c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:2359:x1875828747143296:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 55us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930155.998159:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 129 00010000:00010000:0.0:1788930156.894461:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788930157.506852:0:17367:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 01:02:34 (1788930154) 00000100:00100000:2.0:1788930157.538041:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788930157.538115:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770194304:0@lo:400:kworker.0 00000100:00100000:2.0:1788930157.538191:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930157.538291:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3311:1875828770194176:0@lo:400:kworker.0 00000100:00100000:0.0:1788930157.538308:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770194304 00000100:00100000:0.0:1788930157.538318:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770194304 00000100:00100000:2.0:1788930157.538325:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930157.539707:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788930157.539727:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770194304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930157.539815:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770194304:12345-0@lo:400:kworker.0 Request processed in 97us (1624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930157.539822:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788930157.539865:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788930157.539903:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770194304:0@lo:400:kworker.0 00000100:00100000:0.0:1788930157.542191:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770194432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788930157.542273:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930157.542332:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770194432 00000100:00100000:0.0:1788930157.542340:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770194432 00000100:00100000:0.0:1788930157.542395:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788930157.542404:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770194432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788930157.542458:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788930157.542501:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770194432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930157.542509:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788930157.542530:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788930157.542565:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770194432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788930157.544745:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770194176 00000100:00100000:1.0:1788930157.544760:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770194176 00000100:00100000:0.0:1788930157.545170:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788930157.545181:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3311:x1875828770194176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930157.545304:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3311:x1875828770194176:12345-0@lo:400:kworker.0 Request processed in 124us (6977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930157.545312:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788930157.545448:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3311:1875828770194176:0@lo:400:kworker.0 00000100:00100000:3.0:1788930157.545666:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770194688:0@lo:400:kworker.0 00000100:00100000:3.0:1788930157.545705:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930157.545739:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788930157.545748:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770194816:0@lo:400:kworker.0 00000100:00100000:1.0:1788930157.545749:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770194688 00000100:00100000:1.0:1788930157.545755:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770194688 00000100:00100000:1.0:1788930157.545798:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788930157.545813:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770194688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930157.545871:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770194688:12345-0@lo:400:kworker.0 Request processed in 65us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930157.545878:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788930157.545896:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788930157.545902:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788930157.545938:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770194688:0@lo:400:kworker.0 00000100:00100000:3.0:1788930157.545959:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770194816 00000100:00100000:3.0:1788930157.545963:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770194816 00000100:00100000:3.0:1788930157.546006:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788930157.546013:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875828770194816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930157.546048:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875828770194816:12345-0@lo:400:kworker.0 Request processed in 35us (152us total) trans 0 rc 0/0 00000100:00080000:1.0:1788930157.546055:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788930157.546057:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788930157.546089:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770194816:0@lo:400:kworker.0 00000100:00100000:3.0:1788930157.546102:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788930157.546109:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770194560:0@lo:400:kworker.0 00000100:00100000:3.0:1788930157.546132:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930157.546170:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770194560 00000100:00100000:1.0:1788930157.546175:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770194560 00000100:00100000:1.0:1788930157.546208:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788930157.546216:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770194560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930157.546307:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770194560:12345-0@lo:400:kworker.0 Request processed in 93us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930157.546315:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788930157.546380:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770194560:0@lo:400:kworker.0 00010000:00010000:0.0:1788930157.916306:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930158.939452:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930159.580573:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770194944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788930159.580661:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930159.580857:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770194944 00000100:00100000:3.0:1788930159.580887:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770194944 00000100:00100000:3.0:1788930159.580958:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788930159.580983:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770194944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788930159.581017:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788930159.581066:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770194944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930159.581072:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788930159.581122:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770194944:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788930159.581321:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788930159.966901:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930160.987566:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788930161.114450:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930161.114499:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930161.114540:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930161.114571:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930161.114602:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747143808 00000100:00100000:3.0:1788930161.114611:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747143808 00000100:00100000:3.0:1788930161.114673:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 131 00000100:00100000:3.0:1788930161.114692:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:2361:x1875828747143808:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788930161.114776:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:2361:x1875828747143808:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 93us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930161.114784:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 131 00000100:00100000:3.0:1788930161.114819:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747144064 00000100:00100000:3.0:1788930161.114823:0:15108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747144064 00000100:00100000:3.0:1788930161.114880:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 29 00000100:00100000:3.0:1788930161.114887:0:15108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2361:x1875828747144064:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788930161.114916:0:15108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2361:x1875828747144064:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 29us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930161.114922:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 29 00000100:00080000:3.0:1788930161.115047:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788930161.116092:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747143936 00000100:00100000:1.0:1788930161.116254:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747144192 00000100:00100000:1.0:1788930161.116265:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747144192 00000100:00100000:2.0:1788930161.116273:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747143936 00000100:00100000:1.0:1788930161.116340:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 50 00000100:00100000:1.0:1788930161.116356:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f457351-9f47-4d69-8728-cf079fbb04a5+6:2361:x1875828747144192:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788930161.116426:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6f457351-9f47-4d69-8728-cf079fbb04a5+6:2361:x1875828747144192:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 78us (1926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930161.116433:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 50 00000100:00100000:2.0:1788930161.116516:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 51 00000100:00100000:2.0:1788930161.116525:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+11:2361:x1875828747143936:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930161.116561:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f2435a2-1693-4ef4-8931-95da2710cab3+11:2361:x1875828747143936:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 38us (2122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930161.116569:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 51 00000100:00080000:0.0:1788930161.116655:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788930161.819492:0:14457:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788930161.819502:0:14457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788930161.819538:0:14457:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788930161.819546:0:14457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788930162.018167:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788930162.313560:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930162.313599:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930162.313633:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930162.316156:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930162.316220:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747144832 00000100:00100000:2.0:1788930162.316251:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747144832 00000100:00100000:2.0:1788930162.316305:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 25 00000100:00100000:2.0:1788930162.316316:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+6:2358:x1875828747144832:12345-192.168.204.40@tcp:9:umount.0 00000020:00000080:2.0:1788930162.316354:0:15106:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237dcb9 00000020:00010000:2.0:1788930162.316363:0:15106:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d2d849fc800: total 0 00000100:00080000:2.0:1788930162.316367:0:15106:0:(import.c:65:import_set_state_nolock()) ffff8d2d849fe800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788930162.316404:0:15106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:2.0:1788930162.316680:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f2435a2-1693-4ef4-8931-95da2710cab3+4:2358:x1875828747144832:12345-192.168.204.40@tcp:9:umount.0 Request processed in 365us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930162.316688:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 25 00000020:00010000:2.0:1788930162.316711:0:14411:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d2d849fc800: total 0 00010000:00010000:2.0:1788930162.316714:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930162.316731:0:14411:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d2d849fc800, canceled 0 locks, left on hash table 1. 00002000:00010000:2.0:1788930162.316789:0:14411:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788930162.316792:0:14411:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788930138 -> 1788930140 00002000:00010000:2.0:1788930162.316794:0:14411:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788930138 -> 1788930140 00002000:00010000:2.0:1788930162.316797:0:14411:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1788930162.316838:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5994772/0xce4472dd2237e008 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021071c expref: 3 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930162.316875:0:14411:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d2d849fc800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788930162.316886:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930162.316888:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930162.316890:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930162.318475:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747144320 00000100:00100000:1.0:1788930162.318490:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747144320 00000100:00100000:1.0:1788930162.318543:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747144576 00000100:00100000:1.0:1788930162.318546:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747144576 00000100:00100000:1.0:1788930162.318561:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747144448 00000100:00100000:1.0:1788930162.318564:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747144448 00000100:00100000:1.0:1788930162.318583:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:1.0:1788930162.318593:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+15:2359:x1875828747144320:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788930162.318609:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930162.318625:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2eb5340000/0xce4472dd2237dc9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210578 expref: 15 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930162.318641:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930162.318739:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+14:2359:x1875828747144320:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 147us (5189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930162.318747:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:1.0:1788930162.318765:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:1.0:1788930162.318773:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+13:2359:x1875828747144576:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788930162.318782:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930162.318793:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebc597c00/0xce4472dd2237dd45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210643 expref: 13 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930162.331764:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00010000:00010000:1.0:1788930162.332250:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930162.332321:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+12:2359:x1875828747144576:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 13545us (18717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930162.332333:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:1.0:1788930162.332371:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:1.0:1788930162.332406:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e862c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+11:2359:x1875828747144448:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788930162.332424:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930162.332626:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebe0b8e00/0xce4472dd2237dca4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402105a2 expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930162.332640:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930162.332663:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e862c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+10:2359:x1875828747144448:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 270us (19029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930162.332670:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:3.0:1788930162.334494:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747145728 00000100:00100000:3.0:1788930162.334509:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747145728 00000100:00100000:3.0:1788930162.334572:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 64 00000100:00100000:3.0:1788930162.334582:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+11:2358:x1875828747145728:12345-192.168.204.40@tcp:39:umount.0 00000020:00000080:3.0:1788930162.334618:0:14424:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237dcb2 00000020:00010000:3.0:1788930162.334633:0:14424:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d2d849f9800: total 0 00000100:00080000:3.0:1788930162.334637:0:14424:0:(import.c:65:import_set_state_nolock()) ffff8d2e86b9f000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1788930162.334699:0:14410:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d2d849f9800: total 0 00010000:00010000:2.0:1788930162.334750:0:14410:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d2d849f9800, canceled 0 locks, left on hash table 6. 00010000:00010000:2.0:1788930162.334782:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2e98756600) 00010000:00010000:2.0:1788930162.334786:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930162.334794:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341600/0xce4472dd2237dd7d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210651 expref: 10 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930162.334829:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d2e8528d800) 00010000:00010000:2.0:1788930162.334833:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788930162.334848:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237df52 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106e4 expref: 9 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930162.334876:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e838fb200) 00010000:00010000:2.0:1788930162.334879:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788930162.334883:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237ddb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021065f expref: 8 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930162.334927:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d2e98756900) 00010000:00010000:2.0:1788930162.334930:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788930162.334934:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237de3a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210689 expref: 7 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930162.334949:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d2e98756300) 00010000:00010000:2.0:1788930162.334952:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788930162.334956:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2e99784200/0xce4472dd2237dfad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402106f9 expref: 6 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930162.334969:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2e98756800) 00010000:00010000:2.0:1788930162.334971:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788930162.334975:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341400/0xce4472dd2237dd61 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021064a expref: 5 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930162.334986:0:14410:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d2d849f9800, canceled 6 locks, left on hash table 0. 00010000:00010000:2.0:1788930162.334999:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930162.335000:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930162.335002:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788930162.335566:0:14424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:3.0:1788930162.336407:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f2435a2-1693-4ef4-8931-95da2710cab3+3:2358:x1875828747145728:12345-192.168.204.40@tcp:39:umount.0 Request processed in 1820us (4647us total) trans 8589934637 rc 0/0 00000100:00100000:3.0:1788930162.336419:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 64 00000100:00100000:1.0:1788930162.651940:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770195072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788930162.652012:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930162.652191:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770195456:0@lo:400:kworker.0 00000100:00100000:1.0:1788930162.652249:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930162.652252:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3310:1875828770195200:0@lo:400:kworker.0 00000100:00100000:1.0:1788930162.652273:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788930162.652281:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770195584:0@lo:400:kworker.0 00000100:00100000:3.0:1788930162.652302:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930162.652311:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930162.652336:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770195712:0@lo:400:kworker.0 00000100:00100000:1.0:1788930162.652350:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770195456 00000100:00100000:1.0:1788930162.652358:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770195456 00000100:00100000:3.0:1788930162.652363:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930162.652388:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788930162.652395:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770195328:0@lo:400:kworker.0 00000100:00100000:1.0:1788930162.652410:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770195584 00000100:00100000:1.0:1788930162.652415:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770195584 00000100:00100000:3.0:1788930162.652422:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930162.652446:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770195712 00000100:00100000:1.0:1788930162.652450:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770195712 00000100:00100000:3.0:1788930162.652460:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770195200 00000100:00100000:3.0:1788930162.652465:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770195200 00000100:00100000:1.0:1788930162.652473:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788930162.652485:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770195456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930162.652498:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788930162.652509:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3310:x1875828770195200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930162.652562:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3310:x1875828770195200:12345-0@lo:400:kworker.0 Request processed in 55us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930162.652570:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770195456:12345-0@lo:400:kworker.0 Request processed in 87us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930162.652582:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788930162.652587:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788930162.652609:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788930162.652618:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770195584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930162.652634:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770195328 00000100:00100000:3.0:1788930162.652638:0:15108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770195328 00000100:00100000:1.0:1788930162.652655:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770195584:12345-0@lo:400:kworker.0 Request processed in 38us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930162.652662:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788930162.652671:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788930162.652679:0:15108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770195328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930162.652680:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788930162.652694:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875828770195712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930162.652716:0:15108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770195328:12345-0@lo:400:kworker.0 Request processed in 38us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930162.652723:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788930162.652737:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875828770195712:12345-0@lo:400:kworker.0 Request processed in 46us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930162.652745:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788930162.652766:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788930162.652771:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788930162.652781:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770195328:0@lo:400:kworker.0 00000100:00100000:3.0:1788930162.652797:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3310:1875828770195200:0@lo:400:kworker.0 00000100:00100000:1.0:1788930162.652799:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770195584:0@lo:400:kworker.0 00000100:00100000:3.0:1788930162.652826:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770195712:0@lo:400:kworker.0 00000100:00100000:1.0:1788930162.652831:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770195456:0@lo:400:kworker.0 00000100:00100000:2.0:1788930162.653074:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770195072 00000100:00100000:2.0:1788930162.653079:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770195072 00000100:00100000:2.0:1788930162.653125:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788930162.653134:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770195072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788930162.653165:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788930162.653207:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770195072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930162.653246:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788930162.653280:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770195072:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788930162.653345:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788930163.037259:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930164.059597:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788930164.094319:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930164.094364:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930164.094397:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930164.094545:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747145984 00000100:00100000:1.0:1788930164.094557:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747145984 00000100:00100000:3.0:1788930164.094568:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747145856 00000100:00100000:3.0:1788930164.094575:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747145856 00000100:00100000:3.0:1788930164.094620:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747146112 00000100:00100000:3.0:1788930164.094624:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747146112 00000100:00100000:1.0:1788930164.094630:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:1.0:1788930164.094644:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+12:2361:x1875828747145856:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788930164.094661:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930164.094682:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebe0b9000/0xce4472dd2237dcd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402105da expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930164.094700:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930164.094770:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+11:2361:x1875828747145856:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 130us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930164.094807:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:1.0:1788930164.094826:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:1.0:1788930164.094833:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+10:2361:x1875828747145984:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788930164.094841:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930164.094849:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebe0b9c00/0xce4472dd2237dcdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210604 expref: 10 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930164.094858:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930164.094877:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+9:2361:x1875828747145984:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 45us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930164.094883:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:1.0:1788930164.094896:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:1.0:1788930164.094903:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85136a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+8:2361:x1875828747146112:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788930164.094911:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930164.094920:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237dd22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021063c expref: 8 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930164.094928:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930164.094948:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85136a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+7:2361:x1875828747146112:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 45us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930164.094955:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:2.0:1788930164.106154:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930164.106374:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747146368 00000100:00100000:1.0:1788930164.106385:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747146368 00000100:00100000:1.0:1788930164.106469:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 65 00000100:00080000:0.0:1788930164.106470:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788930164.106481:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+6:2358:x1875828747146368:12345-192.168.204.40@tcp:39:umount.0 00000020:00000080:1.0:1788930164.106541:0:14423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237dcea 00000020:00010000:1.0:1788930164.106552:0:14423:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d2ebefd0800: total 0 00000100:00080000:1.0:1788930164.106557:0:14423:0:(import.c:65:import_set_state_nolock()) ffff8d2ebefd7000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788930164.106588:0:14423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000020:00010000:0.0:1788930164.106600:0:14411:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d2ebefd0800: total 0 00010000:00010000:0.0:1788930164.106605:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930164.106656:0:14411:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d2ebefd0800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788930164.106686:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e838fb200) 00010000:00010000:0.0:1788930164.106690:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788930164.106698:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2eb5341a00/0xce4472dd2237ddc3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210666 expref: 6 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930164.106728:0:14411:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d2ebefd0800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788930164.106738:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930164.106740:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930164.106742:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930164.106804:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6f457351-9f47-4d69-8728-cf079fbb04a5+3:2358:x1875828747146368:12345-192.168.204.40@tcp:39:umount.0 Request processed in 325us (659us total) trans 8589934638 rc 0/0 00000100:00100000:1.0:1788930164.106813:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 65 00000100:00100000:2.0:1788930164.132046:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930164.135851:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747146624 00000100:00100000:3.0:1788930164.135868:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747146624 00000100:00100000:3.0:1788930164.135938:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 133 00000100:00100000:3.0:1788930164.135949:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+7:2358:x1875828747146624:12345-192.168.204.40@tcp:251:umount.0 00000020:00000080:3.0:1788930164.136010:0:14417:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237dc8f 00000020:00010000:3.0:1788930164.136018:0:14417:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d2e86b9e000: total 0 00000100:00080000:3.0:1788930164.136023:0:14417:0:(import.c:65:import_set_state_nolock()) ffff8d2e86b9d000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788930164.136119:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ee1bfcc5-523d-42e7-aa5d-bab7d0395d67+3:2358:x1875828747146624:12345-192.168.204.40@tcp:251:umount.0 Request processed in 171us (4490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930164.136127:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 133 00000020:00010000:2.0:1788930164.136867:0:14410:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d2e86b9e000: total 0 00010000:00010000:2.0:1788930164.136919:0:14410:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d2e86b9e000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788930164.136953:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d86a74400/0xce4472dd2237dc96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210571 expref: 2 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930164.136969:0:14410:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d2e86b9e000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788930164.136979:0:14410:0:(genops.c:885:class_export_put()) final put ffff8d2e86b9e000/ee1bfcc5-523d-42e7-aa5d-bab7d0395d67 00010000:00010000:2.0:1788930164.136996:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930164.136999:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930164.137001:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788930164.137047:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e86b9e000/ee1bfcc5-523d-42e7-aa5d-bab7d0395d67 for MGS 00000020:00000080:1.0:1788930164.137094:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2e86b9d000 for MGS 00000100:00100000:1.0:1788930164.699529:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770195840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788930164.699606:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930164.699717:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770195840 00000100:00100000:2.0:1788930164.699724:0:15110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770195840 00000100:00100000:2.0:1788930164.699798:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788930164.699810:0:15110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770195840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788930164.699846:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788930164.701895:0:15110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770195840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2081us (2281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930164.701909:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788930164.701947:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788930164.702047:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770195840:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788930165.132118:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788930165.824470:0:17562:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788930165.846540:0:17562:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788930165.846605:0:17562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237d9be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d9c5 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930165.846621:0:17562:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237d9be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237d9c5 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930165.846627:0:17562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237d9be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237d9c5 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930165.846634:0:17562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237d9be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237d9c5 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930165.846661:0:17562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788930165.846666:0:17562:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788930165.846692:0:17562:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788930165.846697:0:17562:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788930165.846703:0:17562:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788930165.846732:0:17562:0:(import.c:65:import_set_state_nolock()) ffff8d2e8606c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788930165.847450:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930165.847460:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237d9be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237d9c5 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930165.847469:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340e00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:1.0:1788930165.847473:0:14410:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237d9be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237d9c5 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930165.847480:0:14410:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237d9be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237d9c5 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788930165.847487:0:14410:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237d9be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237d9c5 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788930165.847492:0:14410:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788930165.847494:0:14410:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788930165.847511:0:14410:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788930165.847555:0:14410:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237d9be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237d9c5 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930165.847562:0:14410:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788930165.847590:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237d9be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237d9c5 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930165.847598:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340e00/0xce4472dd2237d9be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237d9c5 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930165.847613:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930165.847615:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930165.847618:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930165.847626:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788930165.847643:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3309:1875828770196096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788930165.847710:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930165.847783:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770196096 00000100:00100000:1.0:1788930165.847790:0:14408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770196096 00000100:00100000:1.0:1788930165.847847:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788930165.847856:0:14408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc81cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+19:3309:x1875828770196096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788930165.847868:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930165.847882:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2eb5340c00/0xce4472dd2237d9c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237d9be expref: 19 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930165.847894:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930165.847927:0:14408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc81cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:3309:x1875828770196096:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930165.847935:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788930165.847999:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3309:1875828770196096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788930165.848081:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875828770195968:0@lo:39:umount.0 00000100:00100000:3.0:1788930165.848116:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930165.848246:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770195968 00000100:00100000:1.0:1788930165.848251:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770195968 00000100:00100000:1.0:1788930165.848281:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788930165.848288:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875828770195968:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788930165.848308:0:16650:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237d9ef 00000100:00080000:1.0:1788930165.848316:0:16650:0:(import.c:65:import_set_state_nolock()) ffff8d2e9824b800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788930165.848375:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3307:x1875828770195968:12345-0@lo:39:umount.0 Request processed in 87us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930165.848381:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000020:00000080:1.0:1788930165.848386:0:16650:0:(genops.c:885:class_export_put()) final put ffff8d2e98248000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788930165.848410:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e98248000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788930165.848454:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2e9824b800 for lustre-MDT0000 00000100:00080000:1.0:1788930165.848482:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e8606c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788930165.848490:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875828770195968:0@lo:39:umount.0 00010000:00010000:2.0:1788930165.848679:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788930165.848690:0:17562:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788930165.848693:0:17562:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788930165.848697:0:17562:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788930165.850125:0:17562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340600/0xce4472dd2237d924 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d92b expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930165.850144:0:17562:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340600/0xce4472dd2237d924 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237d92b expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930165.850169:0:17562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340600/0xce4472dd2237d924 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237d92b expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930165.850177:0:17562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340600/0xce4472dd2237d924 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237d92b expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930165.850197:0:17562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930165.850204:0:17562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c800/0xce4472dd2237dbb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237dbbd expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930165.850211:0:17562:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c800/0xce4472dd2237dbb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237dbbd expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930165.850217:0:17562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c800/0xce4472dd2237dbb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237dbbd expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930165.850298:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930165.850306:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340600/0xce4472dd2237d924 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237d92b expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930165.850313:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340600 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:1.0:1788930165.850317:0:14410:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340600/0xce4472dd2237d924 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237d92b expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930165.850326:0:14410:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340600/0xce4472dd2237d924 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237d92b expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788930165.850333:0:14410:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340600/0xce4472dd2237d924 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237d92b expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788930165.850350:0:14410:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788930165.850352:0:14410:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788930165.850391:0:14410:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340600/0xce4472dd2237d924 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237d92b expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930165.850397:0:14410:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788930165.850436:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340600/0xce4472dd2237d924 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237d92b expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930165.850443:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340600/0xce4472dd2237d924 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237d92b expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930165.850461:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930165.850462:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930165.850464:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930165.850472:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788930165.850489:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3308:1875828770196224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788930165.850567:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930165.850620:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770196224 00000100:00100000:1.0:1788930165.850626:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770196224 00000100:00100000:1.0:1788930165.850672:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788930165.850681:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:3308:x1875828770196224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788930165.850692:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930165.850705:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ec2152400/0xce4472dd2237d92b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237d924 expref: 18 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930165.850718:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930165.850760:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:3308:x1875828770196224:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930165.850773:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788930165.850809:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3308:1875828770196224:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788930165.850954:0:17562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c800/0xce4472dd2237dbb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237dbbd expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930165.851004:0:17562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930165.851012:0:17562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596e00/0xce4472dd2237dd37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237dd3e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930165.851020:0:17562:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596e00/0xce4472dd2237dd37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237dd3e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930165.851027:0:17562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596e00/0xce4472dd2237dd37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237dd3e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930165.851044:0:17562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596e00/0xce4472dd2237dd37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237dd3e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930165.851165:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788930165.851172:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c800/0xce4472dd2237dbb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237dbbd expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930165.851181:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677c800 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:3.0:1788930165.851185:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c800/0xce4472dd2237dbb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237dbbd expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930165.851192:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c800/0xce4472dd2237dbb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237dbbd expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788930165.851200:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c800/0xce4472dd2237dbb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237dbbd expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788930165.851206:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788930165.851208:0:14411:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788930165.851210:0:14411:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788930165.851268:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c800/0xce4472dd2237dbb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237dbbd expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930165.851274:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788930165.851298:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c800/0xce4472dd2237dbb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237dbbd expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930165.851306:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c800/0xce4472dd2237dbb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237dbbd expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930165.851320:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788930165.851330:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596e00/0xce4472dd2237dd37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237dd3e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930165.851336:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596e00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:3.0:1788930165.851339:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596e00/0xce4472dd2237dd37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237dd3e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930165.851346:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596e00/0xce4472dd2237dd37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237dd3e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788930165.851352:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596e00/0xce4472dd2237dd37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237dd3e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788930165.851358:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788930165.851360:0:14411:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788930165.851372:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596e00/0xce4472dd2237dd37 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237dd3e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930165.851377:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788930165.851383:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596e00/0xce4472dd2237dd37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237dd3e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930165.851389:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930165.851391:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930165.851393:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930165.851449:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3310:1875828770196352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788930165.851484:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930165.851531:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788930165.851537:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3310:1875828770196480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788930165.851558:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930165.851581:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770196352 00000100:00100000:0.0:1788930165.851585:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770196352 00000100:00100000:0.0:1788930165.851610:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770196480 00000100:00100000:0.0:1788930165.851613:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770196480 00000100:00100000:0.0:1788930165.851627:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788930165.851633:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+18:3310:x1875828770196352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788930165.851642:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788930165.851652:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebe0b9600/0xce4472dd2237dbbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237dbb6 expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930165.851665:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788930165.851690:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+17:3310:x1875828770196352:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930165.851697:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788930165.851711:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788930165.851717:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+16:3310:x1875828770196480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788930165.851724:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788930165.851737:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebc596000/0xce4472dd2237dd3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237dd37 expref: 16 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930165.851746:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788930165.851779:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+15:3310:x1875828770196480:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930165.851785:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788930165.851810:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3310:1875828770196480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788930165.851818:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3310:1875828770196352:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788930165.852154:0:17562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788930165.852161:0:17562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596e00/0xce4472dd2237dd37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237dd3e expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930165.852172:0:17562:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788930165.852180:0:17562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340a00/0xce4472dd2237d916 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237d91d expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930165.852188:0:17562:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340a00/0xce4472dd2237d916 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237d91d expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930165.852195:0:17562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340a00/0xce4472dd2237d916 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237d91d expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930165.852202:0:17562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340a00/0xce4472dd2237d916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237d91d expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930165.852340:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930165.852347:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340a00/0xce4472dd2237d916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237d91d expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930165.852354:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340a00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:1.0:1788930165.852357:0:14410:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340a00/0xce4472dd2237d916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237d91d expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930165.852364:0:14410:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340a00/0xce4472dd2237d916 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237d91d expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788930165.852369:0:14410:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340a00/0xce4472dd2237d916 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237d91d expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788930165.852374:0:14410:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788930165.852376:0:14410:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1788930165.852392:0:14410:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340a00/0xce4472dd2237d916 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237d91d expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930165.852398:0:14410:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788930165.852442:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3308:1875828770196608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788930165.852479:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930165.852541:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770196608 00000100:00100000:0.0:1788930165.852546:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770196608 00000100:00100000:0.0:1788930165.852576:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788930165.852582:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+15:3308:x1875828770196608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788930165.852590:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788930165.852599:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ec2153c00/0xce4472dd2237d91d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237d916 expref: 15 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930165.852611:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788930165.852655:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340a00/0xce4472dd2237d916 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237d91d expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930165.852663:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930165.852665:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930165.852667:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930165.852856:0:17562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788930165.852861:0:17562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2eb5340a00/0xce4472dd2237d916 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237d91d expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930165.852875:0:17562:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:2.0:1788930165.852879:0:17562:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788930165.852881:0:17562:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788930165.852915:0:17562:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788930165.852919:0:17562:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788930165.852934:0:17562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788930165.852940:0:17562:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:2.0:1788930165.852945:0:17562:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d2d8482c800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788930165.852951:0:17562:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d2e83ce0800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788930165.852958:0:17562:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8d2ebefd0800 6f457351-9f47-4d69-8728-cf079fbb04a5 192.168.204.40@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1788930165.852963:0:17562:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8d2d849f9800 0f2435a2-1693-4ef4-8931-95da2710cab3 192.168.204.40@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934636 stale:0 00000020:00080000:2.0:1788930165.852968:0:17562:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8d2ebccd3380) has exports, disconnecting them 00000020:00080000:2.0:1788930165.852973:0:17562:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d2d8482c800), last request at 1788930162 00000020:00000080:2.0:1788930165.852979:0:17562:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237dba8 00000100:00080000:2.0:1788930165.852995:0:17562:0:(import.c:65:import_set_state_nolock()) ffff8d2d84828000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788930165.853039:0:17562:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2d8482c800): rc 0 00000020:00000080:2.0:1788930165.853042:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2d8482c800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788930165.853050:0:17562:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d2e83ce0800), last request at 1788930162 00000020:00000080:2.0:1788930165.853053:0:17562:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237da74 00000100:00080000:2.0:1788930165.853063:0:17562:0:(import.c:65:import_set_state_nolock()) ffff8d2e83ce5800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788930165.853069:0:17562:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2e83ce0800): rc 0 00000020:00000080:2.0:1788930165.853070:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2e83ce0800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788930165.853077:0:17562:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa545c1cffae0 00000100:00080000:2.0:1788930165.853098:0:17562:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788930165.853101:0:17562:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 3 00000004:00080000:2.0:1788930165.853114:0:17562:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788930165.853169:0:17562:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788930165.853183:0:17562:0:(import.c:65:import_set_state_nolock()) ffff8d2e90255000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788930165.853194:0:17562:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788930165.853197:0:17562:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788930165.853202:0:17562:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788930165.853286:0:17562:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788930165.853302:0:17562:0:(import.c:65:import_set_state_nolock()) ffff8d2e863d3800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788930165.853334:0:17562:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8d2ebccd3380) has no exports 00000020:00000080:1.0:1788930165.853459:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d8482c800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788930165.853527:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e83ce0800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788930165.853554:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2d84828000 for lustre-MDT0000 00000020:00000080:1.0:1788930165.853558:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2e83ce5800 for lustre-MDT0000 00000100:00100000:1.0:1788930165.853574:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770196736:0@lo:9:umount.0 00000100:00100000:1.0:1788930165.853617:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930165.853643:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770196864:0@lo:9:umount.0 00000100:00100000:1.0:1788930165.853663:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930165.853696:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770196736 00000100:00100000:1.0:1788930165.853702:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770196736 00000100:00100000:1.0:1788930165.853732:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770196864 00000100:00100000:1.0:1788930165.853735:0:15106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770196864 00000100:00100000:1.0:1788930165.853779:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788930165.853787:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875828770196736:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788930165.853809:0:15106:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237da90 00000100:00080000:1.0:1788930165.853816:0:15106:0:(import.c:65:import_set_state_nolock()) ffff8d2e98692800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788930165.853846:0:15106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:1.0:1788930165.854010:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3307:x1875828770196736:12345-0@lo:9:umount.0 Request processed in 223us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930165.854017:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788930165.854031:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788930165.854038:0:15106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875828770196864:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788930165.854047:0:15106:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237dbc4 00000100:00080000:1.0:1788930165.854052:0:15106:0:(import.c:65:import_set_state_nolock()) ffff8d2d8482d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788930165.854065:0:15106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1788930165.856326:0:15106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3307:x1875828770196864:12345-0@lo:9:umount.0 Request processed in 2280us (2653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930165.856339:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788930165.856394:0:14418:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788930165.856409:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788930165.856446:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e90255000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788930165.856454:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788930165.856456:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788930165.856460:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770196736:0@lo:9:umount.0 00000100:00080000:1.0:1788930165.856470:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e863d3800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788930165.856486:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788930165.856488:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788930165.856491:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770196864:0@lo:9:umount.0 00010000:00010000:1.0:1788930165.856579:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930165.862830:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+14:3308:x1875828770196608:12345-0@lo:103:ldlm_bl.0 Request processed in 10234us (10336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930165.862848:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788930165.864065:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3308:1875828770196608:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788930165.875634:0:17562:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8d2ebccd3380) has no exports 00000020:00000080:3.0:1788930165.964737:0:17562:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237d971 00000020:00000080:3.0:1788930165.964793:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2e8902d800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788930165.964854:0:17562:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788930165.965969:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e8902d800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788930165.966006:0:17562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788930165.966016:0:17562:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788930165.966020:0:17562:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8d2eb5b8b380) has no exports 00000020:00000080:2.0:1788930165.967318:0:17562:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237d96a 00000020:00000080:2.0:1788930165.967336:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2eb729a800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788930165.967404:0:17562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788930165.967414:0:17562:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788930165.967417:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2eb5423000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788930165.967419:0:17562:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb5423000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788930165.967425:0:17562:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788930165.967561:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb729a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788930166.171558:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788930166.818274:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788930166.818284:0:6716:0:(genops.c:885:class_export_put()) final put ffff8d2ebcc55000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788930166.818306:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0f2435a2-1693-4ef4-8931-95da2710cab3 00000020:00000080:1.0:1788930166.818308:0:6716:0:(genops.c:885:class_export_put()) final put ffff8d2d849fc800/0f2435a2-1693-4ef4-8931-95da2710cab3 00000020:00000080:1.0:1788930166.818322:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2ebcc55000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788930166.818364:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d849fc800/0f2435a2-1693-4ef4-8931-95da2710cab3 for lustre-OST0000 00000020:00000080:1.0:1788930166.818383:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2e98692800 for lustre-OST0000 00000020:00000080:1.0:1788930166.818388:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2d849fe800 for lustre-OST0000 00000001:00100000:3.0:1788930166.830833:0:16657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6f457351-9f47-4d69-8728-cf079fbb04a5 00000001:00080000:3.0:1788930166.830850:0:16657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:3.0:1788930166.830855:0:16657:0:(genops.c:885:class_export_put()) final put ffff8d2ebefd0800/6f457351-9f47-4d69-8728-cf079fbb04a5 00000001:00100000:3.0:1788930166.830875:0:16657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0f2435a2-1693-4ef4-8931-95da2710cab3 00000001:00080000:3.0:1788930166.830880:0:16657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:3.0:1788930166.830882:0:16657:0:(genops.c:885:class_export_put()) final put ffff8d2d849f9800/0f2435a2-1693-4ef4-8931-95da2710cab3 00000020:00000080:1.0:1788930166.831606:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2ebefd0800/6f457351-9f47-4d69-8728-cf079fbb04a5 for lustre-MDT0000 00000020:00000080:1.0:1788930166.831658:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d849f9800/0f2435a2-1693-4ef4-8931-95da2710cab3 for lustre-MDT0000 00000020:00000080:1.0:1788930166.831748:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2ebefd7000 for lustre-MDT0000 00000020:00000080:1.0:1788930166.831754:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2e86b9f000 for lustre-MDT0000 00010000:00010000:1.0:1788930167.197004:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930167.771750:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788930167.775753:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770197120:0@lo:400:kworker.0 00000100:00100000:1.0:1788930167.775828:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930167.775923:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788930167.775930:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770197248:0@lo:400:kworker.0 00000100:00100000:1.0:1788930167.775955:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930167.775989:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770197120 00000100:00100000:1.0:1788930167.775999:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770197120 00000100:00100000:1.0:1788930167.776053:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770197248 00000100:00100000:1.0:1788930167.776056:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770197248 00000100:00100000:1.0:1788930167.776078:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788930167.776087:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875828770197120:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788930167.776094:0:14423:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788930167.776137:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875828770197120:12345-0@lo:400:kworker.0 Request processed in 50us (309us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788930167.776144:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788930167.776162:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788930167.776166:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875828770197248:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788930167.776170:0:14423:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788930167.776205:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875828770197248:12345-0@lo:400:kworker.0 Request processed in 37us (249us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788930167.776210:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788930167.776274:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788930167.776279:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d2eb5b81000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788930167.776283:0:3310:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788930167.778018:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3308:1875828770196992:0@lo:400:kworker.0 00000100:00100000:0.0:1788930167.778101:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930167.778455:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770196992 00000100:00100000:2.0:1788930167.778464:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770196992 00000100:00100000:2.0:1788930167.778559:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788930167.778589:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+14:3308:x1875828770196992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930167.778650:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305+14:3308:x1875828770196992:12345-0@lo:400:kworker.0 Request processed in 82us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930167.778658:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788930167.778757:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3308:1875828770196992:0@lo:400:kworker.0 00000100:00080000:1.0:1788930167.802603:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d2eb5b81000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788930167.802618:0:3310:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 496 00000100:00080000:1.0:1788930167.802635:0:3310:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d2eb5b81000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1788930167.802678:0:3310:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2e9837f480 x1875828770197376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788930167.802753:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875828770197248:0@lo:400:kworker.0 00000100:00080000:1.0:1788930167.802792:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788930167.802797:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d2e83ce1000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788930167.802801:0:3310:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788930167.802804:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d2e83ce1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788930167.802807:0:3310:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 480 00000100:00080000:1.0:1788930167.802813:0:3310:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d2e83ce1000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1788930167.802826:0:3310:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2e9837e300 x1875828770197504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788930167.802835:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770197120:0@lo:400:kworker.0 00000100:00100000:2.0:1788930167.802890:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875828770197376:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788930167.802959:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930167.802997:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875828770197504:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788930167.803019:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930167.804848:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770197376 00000100:00100000:3.0:1788930167.804862:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770197376 00000100:00100000:3.0:1788930167.804902:0:16650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770197504 00000100:00100000:3.0:1788930167.804904:0:16650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770197504 00000100:00100000:3.0:1788930167.804930:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788930167.804938:0:16650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3307:x1875828770197376:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788930167.804957:0:16650:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788930167.806977:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788930167.806989:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875828770197504:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1788930167.807029:0:14424:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788930167.807143:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875828770197504:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 153us (4122us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788930167.807151:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1788930167.807209:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e83ce1000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788930167.807214:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788930167.807217:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875828770197504:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788930167.822831:0:16650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3307:x1875828770197376:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 17882us (19861us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788930167.822846:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788930167.823243:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2eb5b81000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788930167.823250:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788930167.823255:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875828770197376:0@lo:38:ptlrpcd_00_02.0 00000020:01000000:2.0:1788930168.027370:0:17562:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2e98759780 - data ffff8d2eacb925e8/ffff8d2d8603bc00 00000020:01000000:2.0:1788930168.027522:0:17562:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2d850b9ba0 - data ffff8d2d846b9d80/ffff8d2eafe3bc00 00000001:00000004:2.0:1788930168.034583:0:17562:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00080000:1.0:1788930168.138345:0:17562:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788930168.138353:0:17562:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 4 00000004:00080000:1.0:1788930168.138366:0:17562:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788930168.138369:0:17562:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788930168.142954:0:14444:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788930168.142964:0:14444:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:2.0:1788930168.142975:0:14444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1788930168.144739:0:17562:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788930168.144747:0:17562:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1788930168.144760:0:17562:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788930168.144763:0:17562:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788930168.145086:0:14446:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788930168.145090:0:14446:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:3.0:1788930168.145101:0:14446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00010000:00010000:1.0:1788930168.220714:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788930168.228101:0:17562:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237d939 00000020:00000080:3.0:1788930168.228114:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2e90255800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788930168.228619:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e90255800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788930168.229117:0:17562:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237d94e 00000020:00000080:3.0:1788930168.229124:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2e863d0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788930168.229185:0:17562:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788930168.229193:0:17562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788930168.229202:0:17562:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788930168.229206:0:17562:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8d2ebccd0000) has no exports 00000004:01000000:3.0:1788930168.229382:0:17562:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788930168.229501:0:17562:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237d99b 00000020:00000080:3.0:1788930168.229507:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2eb7281800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788930168.230061:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e863d0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788930168.230167:0:17562:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788930168.230173:0:17562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788930168.230185:0:17562:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788930168.230188:0:17562:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8d2eafc9cd40) has no exports 00000020:00000080:3.0:1788930168.230195:0:17562:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237d994 00000020:00000080:3.0:1788930168.230201:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2e863d6000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788930168.230657:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb7281800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1788930168.231087:0:17562:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788930168.231092:0:17562:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788930168.231096:0:17562:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788930168.231102:0:17562:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788930168.231104:0:17562:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788930168.231140:0:17562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788930168.231284:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e863d6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788930168.231293:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2e863d3800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788930168.231686:0:17562:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788930168.231692:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2d84b5b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788930168.231695:0:17562:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d84b5b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788930168.231701:0:17562:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788930168.231781:0:17562:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237d986 00000020:00000080:3.0:1788930168.231788:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2d84b58000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788930168.231832:0:17562:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788930168.231838:0:17562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788930168.231843:0:17562:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788930168.231847:0:17562:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff8d2eafc9b380) has no exports 00000020:00000080:3.0:1788930168.231852:0:17562:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237d97f 00000020:00000080:3.0:1788930168.231856:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2e90252000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788930168.232050:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d84b58000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788930168.232510:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e90252000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788930168.233078:0:17562:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788930168.233084:0:17562:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788930168.233088:0:17562:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 5 00000004:00080000:2.0:1788930168.233093:0:17562:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788930168.233095:0:17562:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788930168.237627:0:17562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788930168.237645:0:17562:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788930168.237682:0:17562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788930168.237687:0:17562:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788930168.237693:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2e90252800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788930168.237697:0:17562:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e90252800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788930168.237723:0:17562:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788930168.237880:0:17562:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237d955 00000020:00000080:2.0:1788930168.237887:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2e863d1000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788930168.242276:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2e90255000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788930168.242297:0:37:0:(genops.c:885:class_export_put()) final put ffff8d2e863d1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788930168.242301:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e863d1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788930168.242312:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788930168.242922:0:17562:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788930168.242931:0:17562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788930168.242940:0:17562:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788930168.242945:0:17562:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8d2ebccd4d40) has no exports 00000020:00000080:2.0:1788930168.242975:0:17562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788930168.242982:0:17562:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788930168.242989:0:17562:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237d95c 00000020:00000080:2.0:1788930168.242996:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2e863d2000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788930168.243005:0:17562:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2ebe0db800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788930168.243008:0:17562:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2ebe0db800 3 00000020:01000004:2.0:1788930168.243011:0:17562:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d2ebe0db800 from lustre-MDT0000 00000020:00000080:2.0:1788930168.243031:0:17562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788930168.243048:0:17562:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788930168.243051:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2e90253800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788930168.243053:0:17562:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e90253800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788930168.243064:0:17562:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788930168.243104:0:17562:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788930168.243108:0:17562:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788930168.243111:0:17562:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788930168.243113:0:17562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788930168.243116:0:17562:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788930168.243123:0:17562:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8d2ebc286800 3e0889e5-a3a3-4d3e-b42f-69d0d8e97305 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788930168.243129:0:17562:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8d2eb5b899c0) has exports, disconnecting them 00000020:00080000:2.0:1788930168.243133:0:17562:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d2ebc286800), last request at 1788930078 00000020:00000080:2.0:1788930168.243147:0:17562:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237d901 00000020:00000080:1.0:1788930168.243339:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e863d1000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788930168.243345:0:37:0:(genops.c:885:class_export_put()) final put ffff8d2e86059800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788930168.243347:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e86059800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788930168.243351:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788930168.243587:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e863d2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1788930168.243637:0:17562:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d2ebc286800: total 0 00000100:00080000:2.0:1788930168.243643:0:17562:0:(import.c:65:import_set_state_nolock()) ffff8d2ebc280800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788930168.243689:0:17562:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2ebc286800): rc 0 00000020:00080000:2.0:1788930168.243694:0:17562:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8d2eb5b899c0) has no exports 00000100:00100000:2.0:1788930168.243761:0:14415:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d2d843c5c00:14415] 0 exiting: rc = 1 00000100:00100000:3.0:1788930168.243888:0:14416:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d2eb57cd000:14416] 1 exiting: rc = 0 00000100:00100000:3.0:1788930168.243943:0:14417:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d2e887a7600:14417] 2 exiting: rc = 0 00000100:00100000:2.0:1788930168.244954:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.244966:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.244971:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.244977:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.244984:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.244989:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.244995:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245001:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245007:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245012:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245018:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245025:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245033:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245039:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245044:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245065:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245081:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245087:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245091:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245097:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245102:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245107:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245112:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245117:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245122:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245127:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245132:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245137:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245143:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245149:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245761:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245768:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245774:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245780:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245786:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245792:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245798:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245804:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245814:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245820:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245826:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245833:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245839:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245847:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245852:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245858:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245863:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245868:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245874:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245880:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245896:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245901:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245906:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245912:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245917:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245923:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245928:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245934:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245939:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245943:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245948:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245953:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245958:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.245963:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788930168.249647:0:17562:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788930168.249657:0:17562:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00010000:1.0:1788930168.251535:0:14410:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d2ebc286800: total 0 00010000:00010000:1.0:1788930168.251545:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930168.251604:0:14410:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d2ebc286800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788930168.251640:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebe0b8200/0xce4472dd2237dd30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237dd29 expref: 9 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930168.251660:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d8677c400/0xce4472dd2237db93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237db8c expref: 8 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930168.251672:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ec2152e00/0xce4472dd2237da35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237da2e expref: 7 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930168.251683:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebe0b9800/0xce4472dd2237dd1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237dd14 expref: 6 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930168.251733:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d8677c600/0xce4472dd2237da5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237da58 expref: 5 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930168.251745:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2eb5340800/0xce4472dd2237db69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237db62 expref: 4 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930168.251754:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d8677d800/0xce4472dd2237d90f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237d908 expref: 3 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930168.251767:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebe0b9200/0xce4472dd2237da27 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xce4472dd2237da20 expref: 2 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930168.251776:0:14410:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d2ebc286800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788930168.252583:0:14410:0:(genops.c:885:class_export_put()) final put ffff8d2ebc286800/3e0889e5-a3a3-4d3e-b42f-69d0d8e97305 00010000:00010000:1.0:1788930168.252984:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930168.252987:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930168.252988:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788930168.260477:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2ebc286800/3e0889e5-a3a3-4d3e-b42f-69d0d8e97305 for MGS 00000020:00000080:3.0:1788930168.260554:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2ebc280800 for MGS 00000020:01000000:2.0:1788930168.260934:0:17562:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2ebcd08120 - data ffff8d2ebb341360/ffff8d2d85ccb800 00000020:01000000:2.0:1788930168.261084:0:17562:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2e87f35de0 - data ffff8d2eb8f385e8/ffff8d2eb53cb000 00000020:00000080:3.0:1788930168.264613:0:17562:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237d8e5 00000020:00000080:3.0:1788930168.264623:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2ebe0d9000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788930168.264645:0:17562:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2ebe0db800 from MGS, refs=2 00000020:01000004:3.0:1788930168.264660:0:17562:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2ebe0db800 2 00000020:01000004:3.0:1788930168.264664:0:17562:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d2ebe0db800 from MGS 00000020:00000080:3.0:1788930168.264687:0:17562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788930168.264694:0:17562:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788930168.264697:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2ebe0dd800/MGS 00000020:00000080:3.0:1788930168.264700:0:17562:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2ebe0dd800/MGS for MGS 00000020:01000000:3.0:1788930168.264718:0:17562:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788930168.264773:0:17562:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788930168.264777:0:17562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788930168.264782:0:17562:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788930168.264789:0:17562:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d2e863d5000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788930168.264795:0:17562:0:(genops.c:1552:class_disconnect_exports()) OBD device 10 (ffff8d2eafc999c0) has exports, disconnecting them 00000020:00080000:3.0:1788930168.264801:0:17562:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d2e863d5000), last request at 1788930078 00000020:00000080:3.0:1788930168.264805:0:17562:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237d9d3 00000020:00080000:3.0:1788930168.264815:0:17562:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2e863d5000): rc 0 00000020:00000080:3.0:1788930168.264819:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2e863d5000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788930168.265426:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2ebe0d9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788930168.265439:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e863d5000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788930168.267289:0:17562:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788930168.267298:0:17562:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788930168.267303:0:17562:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788930168.267311:0:17562:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788930168.267484:0:17562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788930168.267493:0:17562:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788930168.267499:0:17562:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2ebe0db800 1 00000020:00000080:2.0:1788930168.267504:0:17562:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237d8d7 00000020:00000080:2.0:1788930168.267512:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2ebe0db000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788930168.267517:0:17562:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788930168.267522:0:17562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788930168.267525:0:17562:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788930168.267529:0:17562:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8d2eb5b8cd40) has no exports 00000020:00000080:1.0:1788930168.268729:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2e8606c000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788930168.268741:0:36:0:(genops.c:885:class_export_put()) final put ffff8d2e863d7800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788930168.268744:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e863d7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788930168.268752:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788930168.268827:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2ebe0db000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788930168.322184:0:17562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788930168.322200:0:17562:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788930168.322206:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2ebe0da800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788930168.322210:0:17562:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2ebe0da800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788930168.323886:0:17562:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788930168.324030:0:17562:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d2ebe0d8800 00000020:01000000:1.0:1788930168.324054:0:17562:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788930168.324059:0:17562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788930168.324064:0:17562:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788930168.324069:0:17562:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8d2ebccd19c0) has no exports 00000100:00100000:1.0:1788930168.324171:0:14423:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8d2eb72ace00:14423] 1 exiting: rc = 0 00000100:00100000:0.0:1788930168.327899:0:14424:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8d2eb72adc00:14424] 2 exiting: rc = 0 00000100:00100000:2.0:1788930168.328896:0:14421:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8d2e893a1c00:14421] 0 exiting: rc = 1 00000100:00100000:2.0:1788930168.328965:0:16650:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8d2e983a3e00:16650] 3 exiting: rc = 0 00000100:00100000:1.0:1788930168.330054:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330063:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330070:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330078:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330083:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330090:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330095:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330101:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330106:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330111:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330117:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330122:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330127:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330132:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330137:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330142:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330147:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330159:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330165:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330170:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330175:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330180:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330185:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330191:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330195:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330201:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330207:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330727:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330734:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330739:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330748:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330754:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330764:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330770:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330776:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330783:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330800:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330805:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330811:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330816:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330822:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330827:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330832:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330837:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330844:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330849:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330856:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330861:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330868:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330874:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330879:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330885:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330890:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330895:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330900:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330906:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330911:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330916:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330922:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330927:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330932:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330938:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330954:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.330960:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930168.353462:0:14426:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d2eb5d44600:14426] 1 exiting: rc = 0 00000100:00100000:3.0:1788930168.359338:0:14425:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d2eb5d44400:14425] 0 exiting: rc = 1 00000100:00100000:3.0:1788930168.359459:0:16658:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8d2e9059bc00:16658] 2 exiting: rc = 0 00000100:00100000:2.0:1788930168.359886:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.359898:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.359919:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.359926:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.359932:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.359937:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.359942:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.359948:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.359954:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.359960:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.359965:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.359970:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.359977:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.359983:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.359988:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.359993:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.359999:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360004:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360010:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360015:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360020:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360025:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360031:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360036:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360041:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360046:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360051:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360056:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360061:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360066:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360072:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360077:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360082:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360088:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360094:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360099:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360105:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360120:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360126:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360132:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360138:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360144:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360150:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360155:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360160:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360165:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360170:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360175:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360182:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360188:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360193:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360199:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360204:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360211:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360216:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360250:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360257:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360262:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360267:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360272:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360277:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360283:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360288:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360294:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.360789:0:14428:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8d2eb5d44800:14428] 1 exiting: rc = 0 00000100:00100000:2.0:1788930168.361527:0:14427:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8d2eb5d45800:14427] 0 exiting: rc = 1 00000100:00100000:2.0:1788930168.361624:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361633:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361639:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361646:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361651:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361657:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361682:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361689:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361695:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361710:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361717:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361724:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361745:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361754:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361759:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361766:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361773:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361780:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361797:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361814:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361820:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361826:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361832:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361838:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361844:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361850:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361856:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361877:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361884:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361891:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361896:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361904:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361918:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361924:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361931:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361942:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361954:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361960:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.361966:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362139:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362147:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362170:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362181:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362188:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362195:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362201:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362207:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362213:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362218:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362255:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362266:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362291:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362299:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362304:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362310:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362316:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362324:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362330:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362341:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362349:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362356:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362374:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362381:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.362388:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000001:00100000:1.0:1788930168.375525:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788930168.375566:0:7639:0:(genops.c:885:class_export_put()) final put ffff8d2d8482f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788930168.375800:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d8482f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788930168.375862:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2d8482d000 for lustre-OST0001 00000100:00100000:1.0:1788930168.382286:0:14429:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d2eb72ac400:14429] 0 exiting: rc = 1 00000100:00100000:0.0:1788930168.382588:0:14430:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d2d85d33400:14430] 1 exiting: rc = 0 00000100:00100000:1.0:1788930168.382665:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382671:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382676:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382681:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382687:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382691:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382696:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382710:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382716:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382721:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382726:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382730:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382735:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382740:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382746:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382750:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382755:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382759:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382764:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382769:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382773:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382778:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382783:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382795:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382800:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382804:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382809:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382914:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382919:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382924:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382929:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382934:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382939:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382944:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382949:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382954:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382960:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382965:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382971:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382976:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382981:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382987:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382992:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.382997:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383002:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383007:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383012:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383021:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383027:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383032:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383037:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383041:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383046:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383051:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383056:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383061:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383065:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383070:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383075:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383079:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383084:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383088:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383104:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383110:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.383448:0:14431:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d2d85d33600:14431] 0 exiting: rc = 1 00000100:00100000:0.0:1788930168.388202:0:14432:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d2d85d32c00:14432] 1 exiting: rc = 0 00000100:00100000:1.0:1788930168.388740:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388749:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388754:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388759:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388764:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388770:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388775:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388780:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388786:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388792:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388798:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388803:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388807:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388812:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388817:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388823:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388829:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388834:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388839:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388844:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388849:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388854:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388860:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388866:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388871:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388876:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388880:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388886:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388891:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388896:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388913:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.388993:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389013:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389018:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389023:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389029:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389034:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389039:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389121:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389129:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389134:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389139:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389144:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389148:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389153:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389158:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389163:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389168:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389173:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389178:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389183:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389188:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389193:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389198:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389204:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389210:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389215:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389220:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389249:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389254:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389258:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389263:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389268:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.389272:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930168.392841:0:14434:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d2d85d32800:14434] 1 exiting: rc = 0 00000100:00100000:0.0:1788930168.394141:0:14433:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d2d85d32a00:14433] 0 exiting: rc = 1 00000100:00100000:1.0:1788930168.394946:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.394955:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.394960:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.394979:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.394984:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.394990:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.394995:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395000:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395005:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395011:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395017:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395022:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395027:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395032:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395038:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395043:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395050:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395054:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395060:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395065:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395070:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395075:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395080:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395085:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395090:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395095:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395100:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395105:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395111:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395116:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395121:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395125:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395130:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395136:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395141:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395160:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395166:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395171:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395183:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395189:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395194:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395200:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395205:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395210:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395215:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395219:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395256:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395261:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395266:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395271:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395275:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395280:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395284:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395288:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395292:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395296:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395300:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395305:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395310:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395313:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395317:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395321:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395325:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.395329:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930168.396219:0:14435:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8d2ebcc26400:14435] 0 exiting: rc = 1 00000100:00100000:2.0:1788930168.396416:0:14437:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8d2e82a52400:14437] 2 exiting: rc = 0 00000100:00100000:3.0:1788930168.401756:0:14436:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8d2ebcc27e00:14436] 1 exiting: rc = 0 00000100:00100000:1.0:1788930168.401918:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.401927:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.401933:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.401940:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.401945:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.401951:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.401958:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.401963:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.401996:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402011:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402016:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402021:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402027:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402032:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402038:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402043:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402049:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402054:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402060:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402065:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402070:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402075:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402080:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402086:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402091:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402097:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402103:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402108:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402114:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402119:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402124:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402129:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402162:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402169:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402175:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402180:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402186:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402191:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402196:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402202:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402207:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402212:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402218:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402250:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402264:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402269:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402274:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402280:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402287:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402292:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402298:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402304:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402310:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402317:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402323:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402341:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402361:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402368:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402374:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402380:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402386:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402391:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402398:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930168.402404:0:17562:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788930168.415349:0:17562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788930168.415363:0:17562:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788930168.415370:0:17562:0:(genops.c:885:class_export_put()) final put ffff8d2eb5420800/MDS_uuid 00000020:00000080:2.0:1788930168.415374:0:17562:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb5420800/MDS_uuid for MDS 00000020:01000000:2.0:1788930168.415384:0:17562:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788930168.415559:0:17562:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788930169.243961:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930170.269447:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788930171.228438:0:17715:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788930171.254435:0:17715:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788930171.254485:0:17715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677ce00/0xce4472dd2237da58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237da5f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930171.254512:0:17715:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677ce00/0xce4472dd2237da58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237da5f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930171.254519:0:17715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677ce00/0xce4472dd2237da58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237da5f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930171.254525:0:17715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2d8677ce00/0xce4472dd2237da58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237da5f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930171.254560:0:17715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788930171.254566:0:17715:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788930171.254587:0:17715:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788930171.254591:0:17715:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788930171.254597:0:17715:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788930171.254603:0:17715:0:(import.c:65:import_set_state_nolock()) ffff8d2e83ce1000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788930171.254608:0:17715:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788930171.254610:0:17715:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788930171.254612:0:17715:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788930171.254688:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930171.254697:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2d8677ce00/0xce4472dd2237da58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237da5f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.254706:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677ce00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:0.0:1788930171.254709:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2d8677ce00/0xce4472dd2237da58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237da5f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.254718:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2d8677ce00/0xce4472dd2237da58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237da5f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788930171.254725:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2d8677ce00/0xce4472dd2237da58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237da5f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788930171.254731:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788930171.254739:0:14411:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788930171.254741:0:14411:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788930171.254782:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2d8677ce00/0xce4472dd2237da58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237da5f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.254789:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788930171.254918:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788930171.254936:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3309:1875828770197632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788930171.255015:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930171.255080:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770197632 00000100:00100000:3.0:1788930171.255088:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770197632 00000100:00100000:3.0:1788930171.255125:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788930171.255132:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3309:x1875828770197632:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788930171.255138:0:14407:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788930171 with bad export cookie 14863130964316903681 00010000:00010000:0.0:1788930171.256135:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2d8677ce00/0xce4472dd2237da58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237da5f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.256150:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2d8677ce00/0xce4472dd2237da58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237da5f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.256165:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930171.256167:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930171.256169:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930171.269258:0:17715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c200/0xce4472dd2237da2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237da35 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.269280:0:17715:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c200/0xce4472dd2237da2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237da35 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.269287:0:17715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c200/0xce4472dd2237da2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237da35 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.269296:0:17715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c200/0xce4472dd2237da2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237da35 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.269314:0:17715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788930171.269321:0:17715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237dd29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237dd30 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.269349:0:17715:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237dd29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237dd30 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.269356:0:17715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237dd29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237dd30 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.269362:0:17715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237dd29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237dd30 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.269374:0:17715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788930171.269378:0:17715:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788930171.269407:0:17715:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788930171.269412:0:17715:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:0.0:1788930171.269425:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788930171.269431:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c200/0xce4472dd2237da2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237da35 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.269438:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8677c200 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:0.0:1788930171.269442:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c200/0xce4472dd2237da2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237da35 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.269451:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c200/0xce4472dd2237da2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237da35 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788930171.269458:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c200/0xce4472dd2237da2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237da35 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788930171.269464:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788930171.269466:0:14411:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788930171.269474:0:14411:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788930171.269512:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c200/0xce4472dd2237da2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237da35 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.269518:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788930171.269552:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c200/0xce4472dd2237da2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237da35 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.269560:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2d8677c200/0xce4472dd2237da2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237da35 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.269574:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930171.269578:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237dd29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237dd30 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.269583:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8c00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:0.0:1788930171.269587:0:14411:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237dd29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237dd30 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.269594:0:14411:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237dd29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237dd30 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788930171.269600:0:14411:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237dd29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237dd30 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788930171.269605:0:14411:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788930171.269607:0:14411:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788930171.269609:0:14411:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788930171.269621:0:14411:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237dd29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237dd30 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.269627:0:14411:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788930171.269661:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237dd29 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237dd30 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.269668:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8c00/0xce4472dd2237dd29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xce4472dd2237dd30 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930171.269677:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930171.269679:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930171.269681:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930171.269691:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788930171.269708:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3308:1875828770197760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788930171.269778:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930171.270452:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788930171.270465:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3311:1875828770197888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788930171.270503:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930171.270530:0:14408:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788930171.270556:0:14408:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000020:00000080:0.0:1788930171.270697:0:17715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788930171.270705:0:17715:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788930171.270710:0:17715:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8d2e91628000) has no exports 00000020:00080000:0.0:1788930171.270735:0:17715:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8d2e91628000) has no exports 00010000:00010000:2.0:1788930171.270847:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788930171.270861:0:14409:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788930171.270870:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770197760 00000100:00100000:2.0:1788930171.270877:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770197760 00000100:00100000:2.0:1788930171.270913:0:14409:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788930171.270918:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770197888 00000100:00100000:2.0:1788930171.270921:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770197888 00000100:00100000:3.0:1788930171.276432:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3309:x1875828770197632:12345-0@lo:103:ldlm_bl.0 Request processed in 21288us (21406us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788930171.276461:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788930171.276508:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788930171.276512:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.140@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1788930171.276518:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1875828770197760:12345-0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788930171.276519:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8d2ebc281000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788930171.276527:0:3309:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00020000:3.0:1788930171.276530:0:14407:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788930171 with bad export cookie 14863130964316903681 00000100:00100000:3.0:1788930171.276578:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1875828770197760:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (6800us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788930171.276585:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788930171.276600:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788930171.276604:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebc81f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3311:x1875828770197888:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788930171.276608:0:14407:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788930171 with bad export cookie 14863130964316903681 00000100:00100000:3.0:1788930171.276642:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebc81f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3311:x1875828770197888:12345-0@lo:103:ldlm_bl.0 Request processed in 36us (6138us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788930171.276656:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788930171.276698:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.140@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:01000000:0.0:1788930171.277968:0:17715:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2e98759d20 - data ffff8d2eacbcd288/ffff8d2d8603b000 00000020:01000000:0.0:1788930171.278249:0:17715:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2ebcc94120 - data ffff8d2e822e1af8/ffff8d2d86fab000 00000100:00080000:1.0:1788930171.278729:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.140@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788930171.293552:0:3309:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.140@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788930171.293557:0:3309:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788930171.293567:0:3309:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2ebbffa300 x1875828770197632/t0(0) o103->MGC192.168.204.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788930187 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930171.293580:0:3309:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2ebbff8a80 x1875828770197760/t0(0) o103->MGC192.168.204.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788930187 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930171.293589:0:3309:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2ebbffa680 x1875828770197888/t0(0) o103->MGC192.168.204.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788930187 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788930171.294957:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788930171.295783:0:3309:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788930171.295786:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788930171.298731:0:3311:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8d2ebc281000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788930171.298765:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3311:1875828770197888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788930171.302192:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788930171.303236:0:3308:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8d2ebc281000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788930171.303269:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3308:1875828770197760:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788930171.304188:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8d2ebc281000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788930171.304196:0:3309:0:(import.c:545:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 463 00000100:00080000:2.0:1788930171.304211:0:3309:0:(import.c:666:import_select_connection()) MGC192.168.204.140@tcp: import ffff8d2ebc281000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1788930171.304323:0:3309:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d85136300 x1875828770198016/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788930171.304388:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3307:1875828770198016:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1788930171.304439:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875828770198016 offset 0 length 520: 4 00000100:00100000:2.0:1788930171.304507:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3309:1875828770197632:0@lo:103:ldlm_bl.0 00100000:10000000:0.0:1788930171.315738:0:17715:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788930171.363097:0:17715:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237da43 00000020:00000080:2.0:1788930171.363108:0:17715:0:(genops.c:885:class_export_put()) final put ffff8d2eb5b80800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788930171.363136:0:17715:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2e881f6000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788930171.363139:0:17715:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2e881f6000 2 00000020:00000080:0.0:1788930171.363161:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb5b80800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:2.0:1788930171.363207:0:17715:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d2e881f6000 from lustre-OST0000 00000020:00000080:2.0:1788930171.363260:0:17715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788930171.363284:0:17715:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788930171.363288:0:17715:0:(genops.c:885:class_export_put()) final put ffff8d2d84b5a000/lustre-OST0000_UUID 00000020:00000080:2.0:1788930171.363290:0:17715:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2d84b5a000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788930171.363298:0:17715:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788930171.363665:0:17715:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788930171.363670:0:17715:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788930171.363675:0:17715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788930171.363680:0:17715:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788930171.363687:0:17715:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d2eb5354800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788930171.363702:0:17715:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff8d2e881e4d40) has exports, disconnecting them 00000020:00080000:0.0:1788930171.363707:0:17715:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d2eb5354800), last request at 1788930095 00000020:00000080:0.0:1788930171.363711:0:17715:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237da6d 00000020:00080000:0.0:1788930171.363724:0:17715:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2eb5354800): rc 0 00000020:00000080:0.0:1788930171.363728:0:17715:0:(genops.c:885:class_export_put()) final put ffff8d2eb5354800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788930171.364853:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb5354800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788930171.390316:0:17715:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788930171.390326:0:17715:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788930171.390333:0:17715:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788930171.390342:0:17715:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788930171.390502:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2e83ce1000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788930171.390560:0:17715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788930171.390569:0:17715:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788930171.390575:0:17715:0:(genops.c:885:class_export_put()) final put ffff8d2e86b9a800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788930171.390580:0:17715:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e86b9a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788930171.390593:0:17715:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788930171.390675:0:17715:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2e881f6000 1 00000020:00000080:1.0:1788930171.390681:0:17715:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237da12 00000020:00000080:1.0:1788930171.390700:0:17715:0:(genops.c:885:class_export_put()) final put ffff8d2eb5357000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788930171.390714:0:17715:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788930171.390719:0:17715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788930171.390724:0:17715:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788930171.390729:0:17715:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8d2e881e3380) has no exports 00000020:00000080:2.0:1788930171.391593:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb5357000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788930171.423044:0:17715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788930171.423062:0:17715:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788930171.423069:0:17715:0:(genops.c:885:class_export_put()) final put ffff8d2e881f1800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788930171.423075:0:17715:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e881f1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788930171.423084:0:17715:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788930171.423290:0:17715:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d2e881f5000 00000020:02000400:2.0:1788930171.423345:0:17715:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788930172.321483:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788930172.894393:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3e0889e5-a3a3-4d3e-b42f-69d0d8e97305->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788930172.894403:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3e0889e5-a3a3-4d3e-b42f-69d0d8e97305->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788930172.894406:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788930172.894409:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788930172.894413:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d2eb5b81000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788930172.894624:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 552 00000100:00080000:0.0:1788930172.894631:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788930172.894645:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d2eb5b81000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1788930172.894684:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2ebbff9c00 x1875828770198144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788930172.894811:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875828770198144:0@lo:38:kworker.0 00000400:00000100:1.0:1788930172.894862:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875828770198144 offset 0 length 520: 4 00010000:00010000:3.0:1788930173.339966:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788930174.075846:0:17865:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788930174.091953:0:17865:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788930174.092037:0:17865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8800/0xce4472dd2237db8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237db93 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930174.092053:0:17865:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8800/0xce4472dd2237db8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237db93 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930174.092061:0:17865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8800/0xce4472dd2237db8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237db93 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930174.092067:0:17865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8800/0xce4472dd2237db8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237db93 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930174.092092:0:17865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788930174.092098:0:17865:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788930174.092136:0:17865:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788930174.092148:0:17865:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2ebbff9c00 x1875828770198144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788930187 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930174.092181:0:17865:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788930174.092186:0:17865:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788930174.092192:0:17865:0:(import.c:65:import_set_state_nolock()) ffff8d2eb5b81000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788930174.092196:0:17865:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788930174.092200:0:17865:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2ebbff9c00 x1875828770198144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788930187 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930174.092206:0:17865:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788930174.092209:0:17865:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:0.0:1788930174.092268:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875828770198144:0@lo:38:kworker.0 00010000:00010000:1.0:1788930174.092306:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930174.092315:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8800/0xce4472dd2237db8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237db93 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930174.092323:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8800 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:1.0:1788930174.092327:0:14410:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8800/0xce4472dd2237db8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237db93 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930174.092336:0:14410:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8800/0xce4472dd2237db8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237db93 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788930174.092342:0:14410:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8800/0xce4472dd2237db8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237db93 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788930174.092348:0:14410:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788930174.092350:0:14410:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788930174.092353:0:14410:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788930174.092367:0:14410:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2ebc281000 00010000:00010000:1.0:1788930174.092370:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8800/0xce4472dd2237db8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xce4472dd2237db93 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930174.092377:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8800/0xce4472dd2237db8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xce4472dd2237db93 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930174.092398:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930174.092400:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930174.092402:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930174.094651:0:17865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237db62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237db69 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930174.094670:0:17865:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237db62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237db69 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930174.094853:0:17865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237db62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237db69 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930174.094861:0:17865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237db62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237db69 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930174.094890:0:17865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930174.094899:0:17865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596400/0xce4472dd2237dd14 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237dd1b expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930174.094906:0:17865:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596400/0xce4472dd2237dd14 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237dd1b expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930174.094936:0:17865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596400/0xce4472dd2237dd14 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237dd1b expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930174.094942:0:17865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596400/0xce4472dd2237dd14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xce4472dd2237dd1b expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930174.095005:0:17865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788930174.095010:0:17865:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788930174.095036:0:17865:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788930174.095041:0:17865:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788930174.095046:0:17865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788930174.095052:0:17865:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788930174.095057:0:17865:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8d2e881e0000) has no exports 00000020:00080000:2.0:1788930174.095080:0:17865:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8d2e881e0000) has no exports 00000020:01000000:2.0:1788930174.098161:0:17865:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2e98759900 - data ffff8d2eacb6da20/ffff8d2d849ee000 00010000:00010000:1.0:1788930174.098522:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788930174.098534:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237db62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237db69 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930174.098546:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8a00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:1.0:1788930174.098551:0:14410:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237db62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237db69 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930174.098562:0:14410:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237db62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237db69 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788930174.098641:0:14410:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237db62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237db69 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788930174.098646:0:14410:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788930174.098649:0:14410:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788930174.098652:0:14410:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788930174.098669:0:14410:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2ebc281000 00010000:00010000:1.0:1788930174.098882:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237db62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xce4472dd2237db69 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930174.098893:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237db62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xce4472dd2237db69 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930174.098905:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930174.098908:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596400/0xce4472dd2237dd14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237dd1b expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930174.098928:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596400 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:1.0:1788930174.098931:0:14410:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596400/0xce4472dd2237dd14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xce4472dd2237dd1b expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930174.098937:0:14410:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596400/0xce4472dd2237dd14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237dd1b expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788930174.098943:0:14410:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596400/0xce4472dd2237dd14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237dd1b expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788930174.098948:0:14410:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788930174.098950:0:14410:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788930174.098952:0:14410:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788930174.098958:0:14410:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2ebc281000 00010000:00010000:1.0:1788930174.098961:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596400/0xce4472dd2237dd14 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xce4472dd2237dd1b expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930174.098967:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596400/0xce4472dd2237dd14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xce4472dd2237dd1b expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930174.098980:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930174.098982:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930174.098984:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788930174.099039:0:17865:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d2ebe0fba80 - data ffff8d2eacbf0438/ffff8d2d86d46400 00010000:00010000:3.0:1788930174.101689:0:14411:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788930174.117906:0:17865:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788930174.166668:0:17865:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237db77 00000020:00000080:1.0:1788930174.166689:0:17865:0:(genops.c:885:class_export_put()) final put ffff8d2e890d9000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788930174.166708:0:17865:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2d84872800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788930174.166711:0:17865:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2d84872800 2 00000020:01000004:1.0:1788930174.166714:0:17865:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d2d84872800 from lustre-OST0001 00000020:00000080:1.0:1788930174.166739:0:17865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788930174.166762:0:17865:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788930174.166776:0:17865:0:(genops.c:885:class_export_put()) final put ffff8d2e890de000/lustre-OST0001_UUID 00000020:00000080:1.0:1788930174.166780:0:17865:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e890de000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788930174.166787:0:17865:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788930174.166882:0:17865:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 3e0889e5-a3a3-4d3e-b42f-69d0d8e97305->MGS 00010000:00010000:1.0:1788930174.166897:0:17865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2d8677cc00/0xce4472dd2237da20 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237da27 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788930174.166920:0:17865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2d8677cc00/0xce4472dd2237da20 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237da27 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788930174.166927:0:17865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788930174.166929:0:17865:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788930174.166932:0:17865:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788930174.166946:0:17865:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2ebc281000 00010000:00010000:1.0:1788930174.166949:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2d8677cc00/0xce4472dd2237da20 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xce4472dd2237da27 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930174.166964:0:17865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341800/0xce4472dd2237d908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xce4472dd2237d90f expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788930174.166971:0:17865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341800/0xce4472dd2237d908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xce4472dd2237d90f expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788930174.166976:0:17865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788930174.166979:0:17865:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788930174.166980:0:17865:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788930174.166990:0:17865:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d2ebc281000 00010000:00010000:1.0:1788930174.166993:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2eb5341800/0xce4472dd2237d908 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xce4472dd2237d90f expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788930174.167009:0:17865:0:(import.c:65:import_set_state_nolock()) ffff8d2ebc281000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788930174.167019:0:17865:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788930174.167021:0:17865:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788930174.167023:0:17865:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788930174.167027:0:17865:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788930174.167038:0:17865:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d2d85136300 x1875828770198016/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788930181 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788930174.167061:0:17865:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788930174.167064:0:17865:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1788930174.167578:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3e0889e5-a3a3-4d3e-b42f-69d0d8e97305:3307:1875828770198016:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:1.0:1788930174.167669:0:17865:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788930174.167687:0:17865:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237d8f3 00000020:00000080:1.0:1788930174.167692:0:17865:0:(genops.c:885:class_export_put()) final put ffff8d2eb5420000/3e0889e5-a3a3-4d3e-b42f-69d0d8e97305 00000020:01000000:1.0:1788930174.167699:0:17865:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.140@tcp (flags='') 00000020:00000080:1.0:1788930174.167704:0:17865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788930174.167710:0:17865:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.140@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788930174.167713:0:17865:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8d2eb5b88000) has no exports 10000000:01000000:3.0:1788930174.167778:0:14419:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788930174.167921:0:17865:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.140@tcp: client import never connected 00000100:00080000:1.0:1788930174.167925:0:17865:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788930174.167927:0:17865:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788930174.167929:0:17865:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788930174.167930:0:17865:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788930174.167968:0:17865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788930174.167973:0:17865:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.140@tcp (uuid 3e0889e5-a3a3-4d3e-b42f-69d0d8e97305) 00000020:01000000:1.0:1788930174.167978:0:17865:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788930174.167981:0:17865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788930174.167985:0:17865:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788930174.167989:0:17865:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8d2eb5b87800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788930174.167995:0:17865:0:(genops.c:1552:class_disconnect_exports()) OBD device 17 (ffff8d2e916299c0) has exports, disconnecting them 00000020:00080000:1.0:1788930174.167999:0:17865:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8d2eb5b87800), last request at 1788930111 00000020:00000080:1.0:1788930174.168003:0:17865:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237dba1 00000020:00080000:1.0:1788930174.168015:0:17865:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d2eb5b87800): rc 0 00000020:00000080:1.0:1788930174.168018:0:17865:0:(genops.c:885:class_export_put()) final put ffff8d2eb5b87800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788930174.170160:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e890d9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788930174.170184:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb5420000/3e0889e5-a3a3-4d3e-b42f-69d0d8e97305 for MGC192.168.204.140@tcp 00000020:00000080:2.0:1788930174.170191:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2ebc281000 for MGC192.168.204.140@tcp 00000020:00000080:2.0:1788930174.170198:0:8:0:(genops.c:885:class_export_put()) final put ffff8d2ebe0de800/3e0889e5-a3a3-4d3e-b42f-69d0d8e97305 00000020:00000080:2.0:1788930174.170201:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2ebe0de800/3e0889e5-a3a3-4d3e-b42f-69d0d8e97305 for MGC192.168.204.140@tcp 00000020:01000000:2.0:1788930174.170206:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.140@tcp (3e0889e5-a3a3-4d3e-b42f-69d0d8e97305) 00000020:00000080:2.0:1788930174.170972:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb5b87800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788930174.203450:0:17865:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788930174.203462:0:17865:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788930174.203467:0:17865:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788930174.203487:0:17865:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788930174.203568:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1788930174.203609:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d2eb5b81000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1788930174.203837:0:14411:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:2.0:1788930174.204090:0:14405:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8d2ebcb71200:14405] 0 exiting: rc = 1 00000100:00100000:3.0:1788930174.204210:0:14406:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8d2ebcb70e00:14406] 1 exiting: rc = 0 00000100:00100000:2.0:1788930174.204417:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.204868:0:14409:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8d2ebcb70c00:14409] 2 exiting: rc = 0 00000100:00100000:3.0:1788930174.204985:0:14407:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8d2ebcb71600:14407] 0 exiting: rc = 1 00000100:00100000:1.0:1788930174.206250:0:17716:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8d2d85d32e00:17716] 3 exiting: rc = 0 00000100:00100000:0.0:1788930174.206275:0:14408:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8d2ebcb71c00:14408] 1 exiting: rc = 0 00000100:00100000:2.0:1788930174.206393:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.206402:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.206407:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.206413:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.206419:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.206425:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.206751:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.206759:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.206776:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.206787:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.206793:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.206803:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.206809:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.206814:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207165:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207175:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207180:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207185:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207190:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207194:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207199:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207204:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207209:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207215:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207253:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207264:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207425:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207431:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207446:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207463:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207467:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207472:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207477:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207481:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207486:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207491:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207497:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207503:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207509:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207514:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207520:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207525:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207530:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207536:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207542:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207548:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207553:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207558:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207564:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207569:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207574:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207580:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207586:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207601:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207608:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207614:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207620:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207627:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207632:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207638:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207643:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207648:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207653:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.207660:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788930174.209395:0:17865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788930174.209407:0:17865:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788930174.209414:0:17865:0:(genops.c:885:class_export_put()) final put ffff8d2e86b9a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788930174.209418:0:17865:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e86b9a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788930174.209424:0:17865:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788930174.209604:0:17865:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2d84872800 1 00000020:00000080:3.0:1788930174.209611:0:17865:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xce4472dd2237db5b 00000020:00000080:3.0:1788930174.209617:0:17865:0:(genops.c:885:class_export_put()) final put ffff8d2ebefd6000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788930174.209632:0:17865:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788930174.209682:0:17865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788930174.209687:0:17865:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788930174.209691:0:17865:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8d2e881e19c0) has no exports 00000020:00000080:2.0:1788930174.209823:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2ebefd6000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788930174.260994:0:17865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788930174.261010:0:17865:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788930174.261016:0:17865:0:(genops.c:885:class_export_put()) final put ffff8d2e83ce3800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788930174.261021:0:17865:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2e83ce3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788930174.261031:0:17865:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788930174.261449:0:17865:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d2d84875000 00000020:01000000:1.0:1788930174.261472:0:17865:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788930174.261477:0:17865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788930174.261481:0:17865:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788930174.261486:0:17865:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8d2e86378000) has no exports 00000020:00000080:1.0:1788930174.261511:0:17865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788930174.261519:0:17865:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788930174.261522:0:17865:0:(genops.c:885:class_export_put()) final put ffff8d2eb5351000/OSS_uuid 00000020:00000080:1.0:1788930174.261524:0:17865:0:(genops.c:844:class_export_destroy()) destroying export ffff8d2eb5351000/OSS_uuid for OSS 00000020:01000000:1.0:1788930174.261527:0:17865:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788930174.261550:0:14418:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788930174.262947:0:15107:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8d2d87503000:15107] 1 exiting: rc = 0 00000100:00100000:1.0:1788930174.263344:0:15108:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8d2e87dd0c00:15108] 2 exiting: rc = 0 00000100:00100000:1.0:1788930174.265130:0:16618:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8d2e98338400:16618] 3 exiting: rc = 0 00000100:00100000:1.0:1788930174.265196:0:15106:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8d2ebc593e00:15106] 0 exiting: rc = 1 00000100:00100000:1.0:1788930174.265278:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265287:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265292:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265298:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265303:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265308:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265313:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265318:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265323:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265329:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265334:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265340:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265364:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265370:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265375:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265379:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265384:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265389:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265395:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265399:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265404:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265409:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265414:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265418:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265423:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265427:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265432:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265437:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265443:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265448:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265452:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265458:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265463:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265467:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265472:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265478:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265483:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265487:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265492:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265497:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265502:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265507:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265513:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265519:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265525:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265529:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265534:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265548:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265554:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265559:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265564:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265569:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265574:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265579:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265609:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265617:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265624:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265629:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265635:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265640:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265646:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265651:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265656:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.265662:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.268309:0:15109:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8d2e88054000:15109] 0 exiting: rc = 1 00000100:00100000:2.0:1788930174.268412:0:15110:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8d2e88055600:15110] 1 exiting: rc = 0 00000100:00100000:1.0:1788930174.268945:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.268953:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.268958:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.268963:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.268973:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.268979:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.268985:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.268991:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.268996:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269001:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269007:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269013:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269019:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269025:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269030:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269103:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269112:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269117:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269147:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269154:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269160:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269374:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269382:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269388:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269393:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269402:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269407:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269412:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269420:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269426:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269432:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269441:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269447:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269452:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269458:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269463:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269468:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269473:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269478:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269483:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269488:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269493:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269498:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269503:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269509:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269514:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269519:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269524:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269528:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269533:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269539:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269544:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269549:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269564:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269569:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269575:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269579:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269585:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269600:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269606:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269612:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269617:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269623:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.269628:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788930174.270996:0:15111:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8d2e88055a00:15111] 0 exiting: rc = 1 00000100:00100000:2.0:1788930174.271217:0:15113:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8d2e88055200:15113] 2 exiting: rc = 0 00000100:00100000:3.0:1788930174.271788:0:15112:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8d2e88055800:15112] 1 exiting: rc = 0 00000100:00100000:1.0:1788930174.271913:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.271921:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.271927:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.271932:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.271938:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.271944:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.271949:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.271954:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.271960:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.271965:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.271970:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.271975:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.271980:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.271985:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.271990:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.271995:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.271999:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.272005:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.272010:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.272015:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.272021:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.272026:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.272108:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.272116:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.272135:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.272141:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.272146:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.272151:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.272157:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.272162:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273083:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273090:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273096:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273101:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273107:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273113:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273119:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273124:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273130:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273137:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273142:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273148:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273155:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273176:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273184:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273190:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273217:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273305:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273313:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273319:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273327:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273334:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273341:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273348:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273372:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273380:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273385:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273397:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273640:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273658:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273672:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273679:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273684:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.273695:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.290050:0:15115:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8d2eb57b8a00:15115] 1 exiting: rc = 0 00000100:00100000:3.0:1788930174.290512:0:15114:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8d2eb57b8200:15114] 0 exiting: rc = 1 00000100:00100000:3.0:1788930174.294097:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294107:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294113:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294119:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294124:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294129:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294134:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294138:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294143:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294148:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294153:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294157:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294162:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294180:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294184:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294190:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294194:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294200:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294205:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294465:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294473:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294478:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294483:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294488:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294493:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294497:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294502:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294507:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294527:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294534:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294542:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294548:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294554:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294559:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294565:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294570:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294576:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294582:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294600:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294608:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294614:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294619:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294625:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294630:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294636:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294641:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294646:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294652:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294657:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294662:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294668:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294673:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294678:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294683:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294696:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294702:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294706:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294712:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294717:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294723:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294729:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294735:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294740:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788930174.294751:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788930174.309729:0:15117:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8d2eb59f2200:15117] 1 exiting: rc = 0 00000100:00100000:2.0:1788930174.310580:0:15116:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8d2eb59f2c00:15116] 0 exiting: rc = 1 00000100:00100000:0.0:1788930174.310715:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310731:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310754:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310762:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310769:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310776:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310787:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310795:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310812:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310835:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310842:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310850:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310855:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310863:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310885:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310892:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310898:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310903:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310909:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310915:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310921:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310926:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310933:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310940:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310945:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310953:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310973:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310980:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310986:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310992:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.310998:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311005:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311010:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311016:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311022:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311027:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311032:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311039:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311072:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311081:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311086:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311093:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311099:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311105:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311119:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311125:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311130:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311136:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311142:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311149:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311670:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311679:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311685:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311691:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311698:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311704:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311711:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311718:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311726:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311731:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311737:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311744:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311750:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788930174.311757:0:17865:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788930174.329489:0:17865:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788930192.467387:0:18482:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788930202.373497:0:18943:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788930202.373515:0:18943:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788930202.373627:0:18943:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d2e863d1000 00000020:01000004:2.0:1788930202.373642:0:18943:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788930202.373650:0:18943:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788930202.373664:0:18943:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8d2e881e3380) 00000020:00000080:2.0:1788930202.373679:0:18943:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788930202.390073:0:18943:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788930202.395832:0:18943:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:3.0:1788930202.396176:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 515: rc = 0 00100000:10000000:3.0:1788930202.396313:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 515: rc = 0 00100000:10000000:3.0:1788930202.396408:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 515: rc = 0 00100000:10000000:3.0:1788930202.396504:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 515: rc = 0 00100000:10000000:3.0:1788930202.396603:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 515: rc = 0 00100000:10000000:3.0:1788930202.396788:0:18943:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788930202.396857:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 515: rc = 0 00100000:10000000:3.0:1788930202.397116:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 517: rc = 0 00100000:10000000:3.0:1788930202.402340:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 630: rc = 0 00100000:10000000:3.0:1788930202.402443:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 630: rc = 0 00100000:10000000:3.0:1788930202.402830:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 454: rc = 0 00100000:10000000:3.0:1788930202.403180:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 454: rc = 0 00100000:10000000:3.0:1788930202.403452:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 454: rc = 0 00100000:10000000:3.0:1788930202.403696:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 454: rc = 0 00100000:10000000:3.0:1788930202.403937:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 454: rc = 0 00100000:10000000:3.0:1788930202.404786:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 454: rc = 0 00100000:10000000:3.0:1788930202.405081:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 454: rc = 0 00100000:10000000:3.0:1788930202.405357:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 454: rc = 0 00100000:10000000:3.0:1788930202.405609:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 454: rc = 0 00100000:10000000:3.0:1788930202.405853:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 454: rc = 0 00100000:10000000:3.0:1788930202.406122:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 454: rc = 0 00100000:10000000:3.0:1788930202.407667:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 454: rc = 0 00100000:10000000:3.0:1788930202.408111:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 465: rc = 0 00100000:10000000:3.0:1788930202.409768:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 465: rc = 0 00100000:10000000:3.0:1788930202.412733:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 465: rc = 0 00100000:10000000:3.0:1788930202.413018:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 465: rc = 0 00100000:10000000:3.0:1788930202.413299:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 465: rc = 0 00100000:10000000:3.0:1788930202.413573:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 465: rc = 0 00100000:10000000:3.0:1788930202.413822:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 465: rc = 0 00100000:10000000:3.0:1788930202.414075:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 465: rc = 0 00100000:10000000:3.0:1788930202.414354:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 465: rc = 0 00100000:10000000:3.0:1788930202.414611:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 465: rc = 0 00100000:10000000:3.0:1788930202.414848:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 465: rc = 0 00100000:10000000:3.0:1788930202.415101:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 465: rc = 0 00100000:10000000:2.0:1788930202.421611:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 465: rc = 0 00100000:10000000:2.0:1788930202.421900:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 465: rc = 0 00100000:10000000:2.0:1788930202.422159:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 465: rc = 0 00100000:10000000:2.0:1788930202.422441:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 465: rc = 0 00100000:10000000:2.0:1788930202.422682:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 465: rc = 0 00100000:10000000:2.0:1788930202.422923:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 465: rc = 0 00100000:10000000:2.0:1788930202.423180:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 465: rc = 0 00100000:10000000:2.0:1788930202.423459:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 465: rc = 0 00100000:10000000:2.0:1788930202.423692:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 465: rc = 0 00100000:10000000:2.0:1788930202.423932:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 465: rc = 0 00100000:10000000:2.0:1788930202.432017:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 465: rc = 0 00100000:10000000:2.0:1788930202.432620:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 465: rc = 0 00100000:10000000:2.0:1788930202.433086:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 465: rc = 0 00100000:10000000:2.0:1788930202.433828:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 465: rc = 0 00100000:10000000:2.0:1788930202.434654:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 465: rc = 0 00100000:10000000:2.0:1788930202.435146:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 465: rc = 0 00100000:10000000:2.0:1788930202.435647:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 465: rc = 0 00100000:10000000:2.0:1788930202.436087:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 465: rc = 0 00100000:10000000:2.0:1788930202.436639:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 465: rc = 0 00100000:10000000:2.0:1788930202.437863:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 465: rc = 0 00100000:10000000:2.0:1788930202.438509:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 355: rc = 0 00100000:10000000:2.0:1788930202.439755:0:18943:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788930202.440066:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 200: rc = 0 00100000:10000000:2.0:1788930202.440617:0:18943:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788930202.440755:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 200: rc = 0 00100000:10000000:2.0:1788930202.441110:0:18943:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788930202.441181:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 200: rc = 0 00100000:10000000:2.0:1788930202.442029:0:18943:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788930202.442118:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 631: rc = 0 00100000:10000000:2.0:1788930202.442333:0:18943:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788930202.442562:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 631: rc = 0 00100000:10000000:2.0:1788930202.442839:0:18943:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788930202.443028:0:18943:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 631: rc = 0 00000020:00000080:2.0:1788930202.443522:0:18943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788930202.443531:0:18943:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788930202.443541:0:18943:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237e039 00000020:01000004:2.0:1788930202.443549:0:18943:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788930202.443554:0:18943:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788930202.443559:0:18943:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2e863d1000 from MGS 00000020:01000004:2.0:1788930202.443563:0:18943:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788930202.443573:0:18943:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8d2e881e19c0) 00000020:00000080:2.0:1788930202.443592:0:18943:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788930202.443654:0:18943:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2e863d1000 from MGS, refs=2 00080000:01000000:2.0:1788930202.443659:0:18943:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788930202.443665:0:18943:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237e047 00000100:00100000:2.0:1788930202.443836:0:18943:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788930202.444119:0:18943:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788930202.444126:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788930202.447532:0:18943:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788930202.447556:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788930202.450759:0:18943:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788930202.450978:0:18943:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788930202.450985:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788930202.452393:0:18943:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788930202.452403:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788930202.454072:0:18943:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788930202.454085:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788930202.473948:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930202.473956:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930202.473958:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930202.476068:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930202.476073:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930202.476075:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930202.477084:0:18943:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788930202.479814:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788930202.507024:0:18943:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788930202.507047:0:18943:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788930202.507049:0:18943:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788930202.524299:0:18953:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788930202.524537:0:18943:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788930202.524657:0:18943:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788930202.525164:0:18943:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788930202.525492:0:18943:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788930202.525651:0:18943:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788930202.525657:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788930202.537016:0:18943:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788930202.537034:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788930202.537591:0:18943:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788930202.537598:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1788930202.538326:0:18957:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1788930202.538411:0:18943:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788930202.538431:0:18943:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.140@tcp' 00000020:01000004:1.0:1788930202.538433:0:18943:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788930202.538465:0:18943:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.140@tcp (typ=mgc) 00000020:00000080:1.0:1788930202.538479:0:18943:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.140@tcp (ffff8d2eafc999c0) 00000020:00000080:1.0:1788930202.538493:0:18943:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788930202.538638:0:18943:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2e86394000@MGC192.168.204.140@tcp: add connection 192.168.204.140@tcp at head 00010000:00010000:1.0:1788930202.538790:0:18943:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.140@tcp-0 is initialized 00000040:01000000:1.0:1788930202.538795:0:18943:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.140@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788930202.544996:0:18958:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788930202.545118:0:18943:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.140@tcp (uuid c52ce1e4-e465-4485-9875-0a24e445f9ec) 00000020:00000080:1.0:1788930202.545146:0:18943:0:(genops.c:1384:class_connect()) connect: client c52ce1e4-e465-4485-9875-0a24e445f9ec, cookie 0xce4472dd2237e055 00000100:00080000:1.0:1788930202.545158:0:18943:0:(import.c:545:import_select_connection()) MGC192.168.204.140@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788930202.545170:0:18943:0:(import.c:666:import_select_connection()) MGC192.168.204.140@tcp: import ffff8d2e86394000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1788930202.545205:0:18943:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2e9837ed80 x1875828770198272/t0(0) o250->MGC192.168.204.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788930202.545257:0:18943:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c52ce1e4-e465-4485-9875-0a24e445f9ec->MGS 00000020:01000004:1.0:1788930202.545281:0:18943:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788930202.545293:0:18943:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788930202.545306:0:18943:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8d2eafc9b380) 00000020:00000080:1.0:1788930202.545319:0:18943:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788930202.551167:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c52ce1e4-e465-4485-9875-0a24e445f9ec:3307:1875828770198272:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788930202.551262:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930202.553635:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770198272 00000100:00100000:0.0:1788930202.553650:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770198272 00000100:00100000:0.0:1788930202.562573:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788930202.562587:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86746450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3307:x1875828770198272:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788930202.562629:0:18954:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from c52ce1e4-e465-4485-9875-0a24e445f9ec@0@lo t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:0.0:1788930202.562667:0:18954:0:(genops.c:1384:class_connect()) connect: client c52ce1e4-e465-4485-9875-0a24e445f9ec, cookie 0xce4472dd2237e063 00000100:00080000:0.0:1788930202.562805:0:18954:0:(import.c:65:import_set_state_nolock()) ffff8d2eb5a1a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788930202.562892:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86746450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+5:3307:x1875828770198272:12345-0@lo:250:mount.lustre.0 Request processed in 306us (11629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930202.562901:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788930202.564648:0:3307:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.140@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788930202.564663:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.140@tcp: connect to target with instance 0 00000100:00080000:3.0:1788930202.564671:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788930202.564677:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788930202.564680:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e86394000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788930202.564696:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788930202.564703:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788930202.564711:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c52ce1e4-e465-4485-9875-0a24e445f9ec:3307:1875828770198272:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788930202.573001:0:18943:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788930202.573284:0:18943:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788930202.573290:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788930202.576212:0:18943:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788930202.576307:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788930202.577038:0:18943:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788930202.577047:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788930202.577761:0:18943:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788930202.577948:0:18943:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788930202.577954:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788930202.578633:0:18943:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788930202.578640:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788930202.647267:0:18943:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788930202.647721:0:18943:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788930202.647730:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788930202.652282:0:18943:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788930202.652302:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788930202.653576:0:18943:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788930202.653747:0:18943:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788930202.653752:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788930202.654373:0:18943:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788930202.654391:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788930202.656008:0:18943:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788930202.656193:0:18943:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788930202.656199:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788930202.663477:0:18943:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788930202.663497:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788930202.665149:0:18943:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788930202.665384:0:18943:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788930202.665391:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788930202.666181:0:18943:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788930202.666191:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788930202.694806:0:18943:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788930202.695030:0:18943:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788930202.695038:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788930202.696998:0:18943:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788930202.697013:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788930202.697852:0:18943:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788930202.697861:0:18943:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788930202.699089:0:18943:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788930202.699113:0:18943:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788930202.699119:0:18943:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788930202.699288:0:18943:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.140@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788930202.699323:0:18943:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.140@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788930202.699327:0:18943:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788930202.699329:0:18943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788930202.699331:0:18943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788930202.699332:0:18943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788930202.699334:0:18943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788930202.699335:0:18943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788930202.699340:0:18943:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788930202.699342:0:18943:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788930202.699343:0:18943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788930202.699344:0:18943:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788930202.699346:0:18943:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788930202.699348:0:18943:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788930202.699349:0:18943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788930202.699350:0:18943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788930202.699351:0:18943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788930202.699352:0:18943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788930202.699353:0:18943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788930202.699354:0:18943:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788930202.699355:0:18943:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788930202.699356:0:18943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788930202.699357:0:18943:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788930202.699389:0:18943:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788930202.699410:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770198400:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788930202.699477:0:18943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930202.699686:0:18943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9912dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788930202.701564:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770198400 00000100:00100000:1.0:1788930202.701578:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770198400 00000100:00100000:1.0:1788930202.701629:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788930202.701639:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+5:18943:x1875828770198400:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788930202.701699:0:18956:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788930202.701702:0:18956:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788930202.701706:0:18956:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788930202.704771:0:18977:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788930202.705386:0:18956:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:1.0:1788930202.711667:0:18978:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788930202.711677:0:18978:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788930202.711680:0:18978:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788930202.711717:0:18978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788930202.712059:0:18956:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788930202.712072:0:18956:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788930202.722924:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+5:18943:x1875828770198400:12345-0@lo:253:mount.lustre.0 Request processed in 21278us (23438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930202.722945:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788930202.723060:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770198400:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788930202.723078:0:18943:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788930202.723082:0:18943:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788930202.723084:0:18943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788930202.723085:0:18943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788930202.723086:0:18943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788930202.723088:0:18943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788930202.723089:0:18943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788930202.723090:0:18943:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788930202.723092:0:18943:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788930202.723094:0:18943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788930202.723095:0:18943:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788930202.723120:0:18943:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2e863d1000 from lustre-MDT0000 10000000:01000000:0.0:1788930202.723151:0:18943:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788930202.723154:0:18943:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788930202.723158:0:18943:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d2eafc999c0 10000000:01000000:0.0:1788930202.723176:0:18943:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788930202.723185:0:18943:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d2eafc999c0 from 1 10000000:01000000:0.0:1788930202.723188:0:18943:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788930202.723253:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8000/0xce4472dd2237e06a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930202.723265:0:18943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8000/0xce4472dd2237e06a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930202.723275:0:18943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8000/0xce4472dd2237e06a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930202.723295:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770198528:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788930202.723329:0:18943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930202.723362:0:18943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e865b7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788930202.723460:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770198528 00000100:00100000:2.0:1788930202.723467:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770198528 00000100:00100000:2.0:1788930202.723511:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788930202.723520:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+5:18943:x1875828770198528:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788930202.723533:0:18955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930202.723548:0:18955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2e99785200/0xce4472dd2237e071 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237e06a expref: -99 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930202.723581:0:18955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e99785200/0xce4472dd2237e071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237e06a expref: 6 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930202.723592:0:18955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2e99785200/0xce4472dd2237e071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e06a expref: 6 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930202.723600:0:18955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99785200, rc 0) 00000100:00100000:2.0:1788930202.723679:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+6:18943:x1875828770198528:12345-0@lo:101:mount.lustre.0 Request processed in 161us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930202.723686:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788930202.727341:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770198528:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788930202.727378:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8000/0xce4472dd2237e06a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e071 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930202.727393:0:18943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8000/0xce4472dd2237e06a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237e071 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930202.729675:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770198656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788930202.729754:0:18943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930202.729857:0:18943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e831e4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788930202.733485:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770198656 00000100:00100000:3.0:1788930202.733503:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770198656 00000100:00100000:3.0:1788930202.733642:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788930202.733653:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+6:18943:x1875828770198656:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788930202.734070:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+6:18943:x1875828770198656:12345-0@lo:501:mount.lustre.0 Request processed in 417us (4314us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788930202.734078:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788930202.735891:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770198656:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788930202.735942:0:18943:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788930202.736008:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8000/0xce4472dd2237e06a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e071 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930202.736020:0:18943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8000/0xce4472dd2237e06a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e071 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788930202.736029:0:18943:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2e863d1000 10000000:01000000:0.0:1788930202.736037:0:18943:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788930202.736042:0:18943:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d2e863d1000 10000000:01000000:0.0:1788930202.736044:0:18943:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788930202.736048:0:18943:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d2e863d1000 from 1 10000000:01000000:0.0:1788930202.736059:0:18943:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788930202.736112:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9a00/0xce4472dd2237e078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930202.736120:0:18943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9a00/0xce4472dd2237e078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930202.736131:0:18943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9a00/0xce4472dd2237e078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930202.736152:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770198784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788930202.736206:0:18943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930202.736526:0:18943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e865b79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788930202.736586:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770198784 00000100:00100000:2.0:1788930202.736593:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770198784 00000100:00100000:2.0:1788930202.736635:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788930202.736644:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+6:18943:x1875828770198784:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788930202.736656:0:18955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930202.736670:0:18955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2e99784400/0xce4472dd2237e07f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237e078 expref: -99 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930202.736693:0:18955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e99784400/0xce4472dd2237e07f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237e078 expref: 7 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930202.736703:0:18955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2e99784400/0xce4472dd2237e07f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e078 expref: 7 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930202.736711:0:18955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99784400, rc 0) 00000100:00100000:2.0:1788930202.736777:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+7:18943:x1875828770198784:12345-0@lo:101:mount.lustre.0 Request processed in 135us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930202.736783:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788930202.740042:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770198784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788930202.740089:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9a00/0xce4472dd2237e078 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e07f expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930202.740103:0:18943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9a00/0xce4472dd2237e078 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237e07f expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788930202.740124:0:18943:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788930202.740139:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9a00/0xce4472dd2237e078 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e07f expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930202.740147:0:18943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9a00/0xce4472dd2237e078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e07f expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788930202.740154:0:18943:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788930202.740163:0:18943:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788930202.740169:0:18943:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d2e863d1000 10000000:01000000:0.0:1788930202.740189:0:18943:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788930202.740194:0:18943:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788930202.740196:0:18943:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788930202.740260:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9e00/0xce4472dd2237e086 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930202.740268:0:18943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9e00/0xce4472dd2237e086 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930202.740278:0:18943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9e00/0xce4472dd2237e086 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930202.740300:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770198912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788930202.740364:0:18943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930202.740414:0:18943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e865b79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788930202.740514:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770198912 00000100:00100000:3.0:1788930202.740522:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770198912 00000100:00100000:3.0:1788930202.740578:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788930202.740588:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+7:18943:x1875828770198912:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788930202.740602:0:18955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930202.740617:0:18955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc597200/0xce4472dd2237e08d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237e086 expref: -99 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930202.740637:0:18955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc597200/0xce4472dd2237e08d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237e086 expref: 8 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930202.740655:0:18955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc597200/0xce4472dd2237e08d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e086 expref: 8 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930202.740664:0:18955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597200, rc 0) 00000100:00100000:3.0:1788930202.740702:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+8:18943:x1875828770198912:12345-0@lo:101:mount.lustre.0 Request processed in 115us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930202.740709:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788930202.740845:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770198912:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788930202.740858:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9e00/0xce4472dd2237e086 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e08d expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930202.740865:0:18943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9e00/0xce4472dd2237e086 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237e08d expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930202.740917:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770199040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930202.740942:0:18943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930202.740963:0:18943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e865b79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788930202.740977:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770199040 00000100:00100000:0.0:1788930202.740981:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770199040 00000100:00100000:0.0:1788930202.740999:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788930202.741005:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+8:18943:x1875828770199040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930202.741662:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+9:18943:x1875828770199040:12345-0@lo:501:mount.lustre.0 Request processed in 654us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930202.741670:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788930202.742805:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770199040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788930202.744651:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770199168:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788930202.744738:0:18943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930202.744843:0:18943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e84e229c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788930202.747559:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770199168 00000100:00100000:2.0:1788930202.747577:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770199168 00000100:00100000:2.0:1788930202.750559:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788930202.750574:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+9:18943:x1875828770199168:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788930202.751128:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+9:18943:x1875828770199168:12345-0@lo:503:mount.lustre.0 Request processed in 556us (6388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930202.751137:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788930202.755356:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770199168:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788930202.758523:0:18979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c52ce1e4-e465-4485-9875-0a24e445f9ec:18979:1875828770199296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788930202.758761:0:18979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930202.758805:0:18979:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e865b7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788930202.758866:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770199296 00000100:00100000:1.0:1788930202.758875:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770199296 00000100:00100000:1.0:1788930202.758926:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788930202.758935:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+9:18979:x1875828770199296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788930202.759278:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+9:18979:x1875828770199296:12345-0@lo:502:llog_process_th.0 Request processed in 344us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930202.759287:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788930202.759389:0:18979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c52ce1e4-e465-4485-9875-0a24e445f9ec:18979:1875828770199296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788930202.759421:0:18979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788930202.759431:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930202.759433:0:18979:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788930202.759439:0:18979:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788930202.759442:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788930202.759456:0:18979:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8d2e86378000) 00000020:00000080:0.0:1788930202.759477:0:18979:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788930202.759484:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788930202.759572:0:18979:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788930202.759582:0:18979:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237e09b 00000020:00000080:0.0:1788930202.759777:0:18979:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788930202.759781:0:18979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788930202.759784:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930202.759786:0:18979:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788930202.759788:0:18979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788930202.759791:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930202.759793:0:18979:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788930202.759795:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788930202.759802:0:18979:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8d2e8637b380) 00000020:00000080:0.0:1788930202.759811:0:18979:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788930202.759814:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788930202.759816:0:18979:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788930202.759825:0:18979:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788930202.759831:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788930202.759868:0:18979:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2e863d1000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788930202.759880:0:18979:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8d2e8637cd40) 00000020:00000080:0.0:1788930202.759889:0:18979:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788930202.759935:0:18979:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788930202.759942:0:18979:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce4472dd2237e0b0 00000020:00000080:0.0:1788930202.760031:0:18979:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788930202.760037:0:18979:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788930202.760042:0:18979:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xce4472dd2237e0b7 00080000:01000000:0.0:1788930202.760047:0:18979:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788930202.760061:0:18979:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237e0be 00010000:00010000:1.0:1788930202.864027:0:18979:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788930202.864584:0:18979:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:1.0:1788930202.864814:0:18979:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788930202.865346:0:18979:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8d2eafc98000) 00000020:00000080:1.0:1788930202.865365:0:18979:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788930202.865440:0:18979:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788930202.865448:0:18979:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237e0cc 00000020:00000080:3.0:1788930202.866864:0:18979:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788930202.883821:0:18979:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xce4472dd2237e0d3 00000020:00000080:0.0:1788930202.885347:0:18979:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788930202.885365:0:18979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788930202.885371:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930202.885374:0:18979:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788930202.885377:0:18979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788930202.885384:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930202.885386:0:18979:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788930202.885390:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788930202.885437:0:18979:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788930202.885456:0:18979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788930202.885459:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930202.885461:0:18979:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788930202.885464:0:18979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788930202.885466:0:18979:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788930202.885468:0:18979:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788930202.885470:0:18979:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788930202.885471:0:18979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788930202.885473:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930202.885474:0:18979:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788930202.885477:0:18979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788930202.885488:0:18979:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788930202.885492:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930202.885494:0:18979:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788930202.885498:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788930202.885503:0:18979:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:01000000:0.0:1788930202.885531:0:18979:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788930202.885534:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788930202.885547:0:18979:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d2e863799c0) 00000020:00000080:0.0:1788930202.885570:0:18979:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788930202.885576:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788930202.885643:0:18979:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788930202.885650:0:18979:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788930202.885657:0:18979:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237e0e1 00010000:00080000:0.0:1788930202.886559:0:18979:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2eb7298000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:0.0:1788930202.887843:0:18979:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788930202.888620:0:18979:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788930202.888748:0:18979:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788930202.891498:0:18979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788930202.891591:0:18979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788930202.891680:0:18979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1788930202.893180:0:18983:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788930202.893187:0:18983:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788930202.893783:0:18979:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788930202.893795:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788930202.893824:0:18979:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788930202.893840:0:18979:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce4472dd2237e0e8 00000100:00080000:1.0:1788930202.893849:0:18979:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788930202.893861:0:18979:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d2eb7298000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1788930202.893896:0:18979:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2e9837d180 x1875828770199424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788930202.893941:0:18979:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788930202.894005:0:18979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788930202.894009:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930202.894011:0:18979:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788930202.894013:0:18979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788930202.894016:0:18979:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788930202.894018:0:18979:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788930202.894019:0:18979:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788930202.894021:0:18979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788930202.894023:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930202.894024:0:18979:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788930202.894026:0:18979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788930202.894030:0:18979:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788930202.894033:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930202.894034:0:18979:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788930202.894037:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788930202.894040:0:18979:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.140@tcp to nid 0x20000c0a8cc8c (192.168.204.140@tcp) 00000020:01000000:1.0:1788930202.894070:0:18979:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788930202.894073:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788930202.894083:0:18979:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d2eafc9cd40) 00000020:00000080:1.0:1788930202.894094:0:18979:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788930202.894097:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788930202.894159:0:18979:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788930202.894164:0:18979:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788930202.894169:0:18979:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xce4472dd2237e0f6 00010000:00080000:1.0:1788930202.894195:0:18979:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2e986b1000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:1.0:1788930202.894420:0:18979:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788930202.894574:0:18979:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788930202.894591:0:18979:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788930202.895089:0:18979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788930202.895150:0:18979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788930202.895218:0:18979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00100000:2.0:1788930202.895715:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c52ce1e4-e465-4485-9875-0a24e445f9ec:3311:1875828770199552:0@lo:400:kworker.0 00000100:00100000:2.0:1788930202.895780:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930202.895924:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770199552 00000100:00100000:0.0:1788930202.895933:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770199552 00000100:00100000:0.0:1788930202.895979:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788930202.895989:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+9:3311:x1875828770199552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930202.896059:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+9:3311:x1875828770199552:12345-0@lo:400:kworker.0 Request processed in 60us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930202.896066:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788930202.896115:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c52ce1e4-e465-4485-9875-0a24e445f9ec:3311:1875828770199552:0@lo:400:kworker.0 00000100:00100000:3.0:1788930202.896264:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770199424:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788930202.896295:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875828770199424 offset 0 length 520: 4 00000040:00080000:0.0:1788930202.897075:0:18985:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788930202.897080:0:18985:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788930202.897870:0:18979:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788930202.897883:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788930202.897913:0:18979:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788930202.897933:0:18979:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce4472dd2237e0fd 00000100:00080000:1.0:1788930202.897942:0:18979:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788930202.897955:0:18979:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2e986b1000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1788930202.897994:0:18979:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2e9837c700 x1875828770199680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788930202.898022:0:18979:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788930202.898198:0:18979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788930202.898202:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930202.898204:0:18979:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788930202.898207:0:18979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788930202.898211:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930202.898213:0:18979:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788930202.898216:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788930202.898217:0:18979:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788930202.898220:0:18979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788930202.898248:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930202.898250:0:18979:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788930202.898254:0:18979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788930202.898256:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930202.898258:0:18979:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788930202.898261:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788930202.898294:0:18979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c52ce1e4-e465-4485-9875-0a24e445f9ec:18979:1875828770199808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788930202.898369:0:18979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930202.898408:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770199808 00000100:00100000:1.0:1788930202.898415:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770199808 00000100:00100000:1.0:1788930202.898448:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788930202.898456:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+9:18979:x1875828770199808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788930202.898698:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+9:18979:x1875828770199808:12345-0@lo:502:llog_process_th.0 Request processed in 242us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930202.898706:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788930202.898752:0:18979:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e89077b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788930202.898771:0:18979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c52ce1e4-e465-4485-9875-0a24e445f9ec:18979:1875828770199808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788930202.898795:0:18979:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788930202.898799:0:18979:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930202.898801:0:18979:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788930202.898804:0:18979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:3.0:1788930202.899083:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770199680:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788930202.899126:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875828770199680 offset 0 length 520: 4 00000020:01000000:2.0:1788930202.899780:0:18943:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788930202.899808:0:18943:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788930202.899827:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9e00/0xce4472dd2237e086 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e08d expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930202.899837:0:18943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9e00/0xce4472dd2237e086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e08d expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930202.899845:0:18943:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2e863d1000 from 1 10000000:01000000:2.0:1788930202.899848:0:18943:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788930202.899879:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930202.899887:0:18943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930202.899905:0:18943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930202.899923:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85134380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770199936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788930202.899970:0:18943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930202.899998:0:18943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e886c2480 going to sleep for 11 seconds 00000100:00100000:3.0:1788930202.900076:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770199936 00000100:00100000:3.0:1788930202.900083:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770199936 00000100:00100000:3.0:1788930202.900125:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788930202.900133:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+9:18943:x1875828770199936:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788930202.900144:0:18954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930202.900157:0:18954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc596c00/0xce4472dd2237e10b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237e104 expref: -99 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930202.900178:0:18954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc596c00/0xce4472dd2237e10b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237e104 expref: 10 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930202.900200:0:18954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc596c00/0xce4472dd2237e10b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e104 expref: 10 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930202.900209:0:18954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596c00, rc 0) 00000100:00100000:3.0:1788930202.900275:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+10:18943:x1875828770199936:12345-0@lo:101:mount.lustre.0 Request processed in 142us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930202.900282:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788930202.900412:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85134380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770199936:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788930202.900434:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e104 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e10b expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930202.900443:0:18943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e104 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237e10b expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930202.900998:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770200064:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788930202.901061:0:18943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930202.901100:0:18943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e865b7240 going to sleep for 11 seconds 00000100:00100000:3.0:1788930202.901256:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770200064 00000100:00100000:3.0:1788930202.901262:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770200064 00000100:00100000:3.0:1788930202.901292:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788930202.901299:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+10:18943:x1875828770200064:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788930202.901316:0:18956:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788930202.901321:0:18956:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788930202.901385:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+10:18943:x1875828770200064:12345-0@lo:256:mount.lustre.0 Request processed in 86us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930202.901392:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788930202.901564:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770200064:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788930202.902165:0:18943:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788930202.902188:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e104 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e10b expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930202.902200:0:18943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e10b expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788930202.902208:0:18943:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2e863d1000 from 1 10000000:01000000:0.0:1788930202.902211:0:18943:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788930202.902282:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8400/0xce4472dd2237e112 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930202.902290:0:18943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8400/0xce4472dd2237e112 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930202.902298:0:18943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8400/0xce4472dd2237e112 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930202.902315:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770200192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788930202.902358:0:18943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930202.902383:0:18943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e865b7240 going to sleep for 11 seconds 00000100:00100000:3.0:1788930202.902524:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770200192 00000100:00100000:3.0:1788930202.902530:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770200192 00000100:00100000:3.0:1788930202.902566:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788930202.902574:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+10:18943:x1875828770200192:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788930202.902586:0:18956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930202.902598:0:18956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e119 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237e112 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930202.902618:0:18956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e119 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237e112 expref: 11 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930202.902640:0:18956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e119 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e112 expref: 11 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930202.902648:0:18956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597400, rc 0) 00000100:00100000:3.0:1788930202.902693:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+11:18943:x1875828770200192:12345-0@lo:101:mount.lustre.0 Request processed in 119us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930202.902699:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788930202.902738:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770200192:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788930202.902750:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8400/0xce4472dd2237e112 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e119 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930202.902758:0:18943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8400/0xce4472dd2237e112 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237e119 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930202.902818:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770200320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788930202.902841:0:18943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930202.902858:0:18943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e993e5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788930202.902870:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770200320 00000100:00100000:3.0:1788930202.902873:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770200320 00000100:00100000:3.0:1788930202.902889:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788930202.902894:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+11:18943:x1875828770200320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788930202.903318:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+11:18943:x1875828770200320:12345-0@lo:501:mount.lustre.0 Request processed in 421us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930202.903325:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788930202.903358:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770200320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788930202.903396:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770200448:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788930202.903435:0:18943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930202.903448:0:18943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e993e5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788930202.903461:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770200448 00000100:00100000:3.0:1788930202.903465:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770200448 00000100:00100000:3.0:1788930202.903484:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788930202.903490:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+11:18943:x1875828770200448:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788930202.903632:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+11:18943:x1875828770200448:12345-0@lo:503:mount.lustre.0 Request processed in 141us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930202.903639:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788930202.903676:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770200448:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788930202.903884:0:18987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c52ce1e4-e465-4485-9875-0a24e445f9ec:18987:1875828770200576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788930202.903917:0:18987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930202.903935:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770200576 00000100:00100000:3.0:1788930202.903939:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770200576 00000100:00100000:3.0:1788930202.903955:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788930202.903961:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+11:18987:x1875828770200576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788930202.904137:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+11:18987:x1875828770200576:12345-0@lo:502:llog_process_th.0 Request processed in 174us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930202.904143:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788930202.904168:0:18987:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e993e5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788930202.904180:0:18987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c52ce1e4-e465-4485-9875-0a24e445f9ec:18987:1875828770200576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788930202.904199:0:18987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788930202.904208:0:18987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930202.904214:0:18987:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788930202.904242:0:18987:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2e863d1000 00000020:00000080:3.0:1788930202.904245:0:18987:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788930202.904253:0:18987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788930202.904256:0:18987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930202.904257:0:18987:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788930202.904260:0:18987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788930202.904263:0:18987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930202.904264:0:18987:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788930202.904267:0:18987:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2e863d1000 00000020:00000080:3.0:1788930202.904269:0:18987:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788930202.904318:0:18987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788930202.906281:0:18987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788930202.906288:0:18987:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788930202.906297:0:18987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788930202.906304:0:18987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788930202.906305:0:18987:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788930202.906312:0:18987:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2e863d1000 00000020:00000080:2.0:1788930202.906315:0:18987:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788930202.906401:0:18987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c52ce1e4-e465-4485-9875-0a24e445f9ec:18987:1875828770200704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788930202.906474:0:18987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930202.906507:0:18987:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e886c2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788930202.907373:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770200704 00000100:00100000:0.0:1788930202.907384:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770200704 00000100:00100000:0.0:1788930202.907442:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788930202.907450:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+11:18987:x1875828770200704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788930202.911892:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+11:18987:x1875828770200704:12345-0@lo:502:llog_process_th.0 Request processed in 4433us (5408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930202.911907:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788930202.921873:0:18987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c52ce1e4-e465-4485-9875-0a24e445f9ec:18987:1875828770200704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788930202.921926:0:18987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788930202.921936:0:18987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788930202.921938:0:18987:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788930202.921944:0:18987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788930202.930287:0:18943:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788930202.930324:0:18943:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788930202.930348:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8400/0xce4472dd2237e112 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e119 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930202.930362:0:18943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8400/0xce4472dd2237e112 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e119 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930202.930420:0:18943:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788930202.930423:0:18943:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2e863d1000 10000000:01000000:2.0:1788930202.930426:0:18943:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2e863d1000 10000000:01000000:2.0:1788930202.930431:0:18943:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788930202.930437:0:18943:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2e863d1000 from 1 10000000:01000000:2.0:1788930202.930439:0:18943:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788930202.930476:0:18943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99785400/0xce4472dd2237e120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930202.930485:0:18943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e99785400/0xce4472dd2237e120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930202.930496:0:18943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e99785400/0xce4472dd2237e120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930202.930521:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770200832:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788930202.930586:0:18943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930202.930622:0:18943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e886c2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788930202.930645:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770200832 00000100:00100000:2.0:1788930202.930651:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770200832 00000100:00100000:2.0:1788930202.930706:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788930202.930715:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+11:18943:x1875828770200832:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788930202.930728:0:18955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930202.930741:0:18955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2e99784200/0xce4472dd2237e127 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237e120 expref: -99 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930202.930762:0:18955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e99784200/0xce4472dd2237e127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237e120 expref: 12 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930202.930783:0:18955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2e99784200/0xce4472dd2237e127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e120 expref: 12 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930202.930791:0:18955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99784200, rc 0) 00000100:00100000:2.0:1788930202.930829:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:18943:x1875828770200832:12345-0@lo:101:mount.lustre.0 Request processed in 115us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930202.930836:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788930202.930882:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770200832:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788930202.930895:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e99785400/0xce4472dd2237e120 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e127 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930202.930903:0:18943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e99785400/0xce4472dd2237e120 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237e127 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930202.930946:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770200960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788930202.930970:0:18943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930202.930992:0:18943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e886c2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788930202.931282:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770200960 00000100:00100000:1.0:1788930202.931288:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770200960 00000100:00100000:1.0:1788930202.931317:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788930202.931325:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:18943:x1875828770200960:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788930202.931562:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:18943:x1875828770200960:12345-0@lo:501:mount.lustre.0 Request processed in 237us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930202.931568:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788930202.933859:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770200960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788930202.933938:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770201088:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788930202.934013:0:18943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930202.934133:0:18943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e886c2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788930202.934475:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770201088 00000100:00100000:1.0:1788930202.934482:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770201088 00000100:00100000:1.0:1788930202.934532:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788930202.934541:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:18943:x1875828770201088:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788930202.934749:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:18943:x1875828770201088:12345-0@lo:503:mount.lustre.0 Request processed in 208us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930202.934757:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788930202.935285:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770201088:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788930202.940066:0:18992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c52ce1e4-e465-4485-9875-0a24e445f9ec:18992:1875828770201216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788930202.940150:0:18992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930202.940201:0:18992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e865b7300 going to sleep for 11 seconds 00000100:00100000:1.0:1788930202.940268:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770201216 00000100:00100000:1.0:1788930202.940276:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770201216 00000100:00100000:1.0:1788930202.940320:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788930202.940329:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:18992:x1875828770201216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788930202.940582:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:18992:x1875828770201216:12345-0@lo:502:llog_process_th.0 Request processed in 253us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930202.940590:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788930202.940706:0:18992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c52ce1e4-e465-4485-9875-0a24e445f9ec:18992:1875828770201216:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788930202.940766:0:18992:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788930202.940780:0:18992:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8d2e87ca8000) 00000020:00000080:0.0:1788930202.940800:0:18992:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788930202.940871:0:18992:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2e863d1000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788930202.940875:0:18992:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2e863d1000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788930202.940877:0:18992:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2e863d1000 4 00010000:00080000:0.0:1788930202.940915:0:18992:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2e88731800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.140@tcp at head 00010000:00010000:0.0:1788930202.942547:0:18992:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788930202.942754:0:18992:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788930202.942786:0:18992:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788930202.942800:0:18992:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xce4472dd2237e135 00000100:00080000:0.0:1788930202.942809:0:18992:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788930202.942820:0:18992:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d2e88731800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1788930202.942854:0:18992:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2ebbff9880 x1875828770201344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788930202.942912:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875828770201344:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788930202.942974:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930202.943041:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770201344 00000100:00100000:0.0:1788930202.943058:0:18961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770201344 00000100:00100000:0.0:1788930202.943095:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788930202.943102:0:18961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875828770201344:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788930202.943153:0:18961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875828770201344:12345-0@lo:38:llog_process_th.0 Request processed in 50us (178us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788930202.943159:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788930202.943189:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788930202.943196:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e88731800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788930202.943211:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788930202.943215:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875828770201344:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788930202.943264:0:18992:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788930202.955137:0:18992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c52ce1e4-e465-4485-9875-0a24e445f9ec:18992:1875828770201472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788930202.955271:0:18992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930202.955308:0:18992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e865b7240 going to sleep for 11 seconds 00000100:00100000:3.0:1788930202.955430:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770201472 00000100:00100000:3.0:1788930202.955438:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770201472 00000100:00100000:3.0:1788930202.955489:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788930202.955498:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:18992:x1875828770201472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788930202.955771:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:18992:x1875828770201472:12345-0@lo:502:llog_process_th.0 Request processed in 272us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930202.955779:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788930202.955974:0:18992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c52ce1e4-e465-4485-9875-0a24e445f9ec:18992:1875828770201472:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788930202.956003:0:18992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788930202.956178:0:18943:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788930202.956199:0:18943:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788930202.956218:0:18943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99785400/0xce4472dd2237e120 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e127 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930202.956249:0:18943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e99785400/0xce4472dd2237e120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e127 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788930202.956295:0:18943:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788930202.956298:0:18943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788930202.956299:0:18943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788930202.956300:0:18943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788930202.956301:0:18943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788930202.956303:0:18943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788930202.956304:0:18943:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788930202.956305:0:18943:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788930202.956306:0:18943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788930202.956308:0:18943:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788930202.956311:0:18943:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788930202.956313:0:18943:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788930202.956315:0:18943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788930202.956316:0:18943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788930202.956317:0:18943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788930202.956318:0:18943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788930202.956319:0:18943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788930202.956320:0:18943:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788930202.956321:0:18943:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788930202.956322:0:18943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788930202.956323:0:18943:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788930202.956340:0:18943:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788930202.956354:0:18943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770201600:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788930202.956407:0:18943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930202.956429:0:18943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e886a66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788930202.956835:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770201600 00000100:00100000:0.0:1788930202.956843:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770201600 00000100:00100000:0.0:1788930202.959649:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788930202.959686:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:18943:x1875828770201600:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788930202.959754:0:18954:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788930202.959778:0:18954:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788930203.017095:0:18954:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788930203.017118:0:18954:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788930203.017239:0:18977:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788930203.017244:0:18977:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788930203.017270:0:18977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237e13c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930203.017288:0:18977:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ebc596c00/0xce4472dd2237e10b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e104 expref: 12 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930203.017297:0:18977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237e13c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930203.017338:0:18977:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ebc596c00/0xce4472dd2237e10b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237e104 expref: 12 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930203.017352:0:18977:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2ebc596c00/0xce4472dd2237e10b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237e104 expref: 12 pid: 18954 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930203.017366:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18977:1875828770201728:0@lo:104: 00000100:00100000:0.0:1788930203.017438:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930203.017490:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e865b7240 going to sleep for 11 seconds 00000100:00100000:3.0:1788930203.017613:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770201728 00000100:00100000:3.0:1788930203.017623:0:18944:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770201728 00000100:00100000:3.0:1788930203.017684:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788930203.017694:0:18944:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c52ce1e4-e465-4485-9875-0a24e445f9ec+3:18977:x1875828770201728:12345-0@lo:104: 00010000:00010000:3.0:1788930203.017709:0:18944:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237e10b expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930203.017763:0:18944:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788930203.017769:0:18944:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c52ce1e4-e465-4485-9875-0a24e445f9ec+3:18977:x1875828770201728:12345-0@lo:104: Request processed in 78us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930203.017776:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788930203.017817:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788930203.017823:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237e10b expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930203.017832:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99784c00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:3.0:1788930203.017836:0:18950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237e10b expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930203.017845:0:18950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237e10b expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788930203.017852:0:18950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237e10b expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788930203.017858:0:18950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788930203.017886:0:18950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e104 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e10b expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930203.017892:0:18950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788930203.017913:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e104 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e10b expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930203.017920:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e104 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e10b expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930203.017940:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930203.017941:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930203.017943:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788930203.017965:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c52ce1e4-e465-4485-9875-0a24e445f9ec:3308:1875828770201856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788930203.017994:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930203.018155:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18977:1875828770201728:0@lo:104: 00010000:00010000:0.0:1788930203.018178:0:18977:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237e13c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930203.018295:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770201856 00000100:00100000:1.0:1788930203.018301:0:18946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770201856 00010000:00010000:1.0:1788930203.018320:0:18946:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ebc596c00/0xce4472dd2237e10b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237e104 expref: 13 pid: 18954 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930203.018344:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788930203.018351:0:18946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c52ce1e4-e465-4485-9875-0a24e445f9ec+13:3308:x1875828770201856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788930203.018361:0:18946:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930203.018366:0:18946:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ebc596c00/0xce4472dd2237e10b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237e104 expref: 13 pid: 18954 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930203.018375:0:18946:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ebc596c00/0xce4472dd2237e10b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237e104 expref: 13 pid: 18954 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930203.018388:0:18946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebc596c00/0xce4472dd2237e10b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237e104 expref: 13 pid: 18954 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930203.018401:0:18946:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237e13c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930203.018408:0:18946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237e13c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788930203.018421:0:18946:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001177494s 00010000:00010000:1.0:1788930203.018425:0:18946:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237e13c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930203.018432:0:18946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237e13c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930203.018445:0:18946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237e13c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930203.018451:0:18946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237e13c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930203.018456:0:18946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8c00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930203.018460:0:18946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237e13c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930203.018468:0:18946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237e13c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930203.018487:0:18946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237e13c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930203.018504:0:18946:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930203.018537:0:18946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:3308:x1875828770201856:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930203.018544:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788930203.019558:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c52ce1e4-e465-4485-9875-0a24e445f9ec:3308:1875828770201856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788930203.019978:0:18977:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237e13c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930203.019991:0:18977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237e13c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930203.019998:0:18977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237e13c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930203.079517:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+11:18943:x1875828770201600:12345-0@lo:253:mount.lustre.0 Request processed in 119843us (123098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930203.079549:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788930203.079784:0:18943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:18943:1875828770201600:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788930203.079804:0:18943:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788930203.079807:0:18943:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788930203.079808:0:18943:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788930203.079810:0:18943:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788930203.079811:0:18943:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788930203.079812:0:18943:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788930203.079814:0:18943:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788930203.079815:0:18943:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788930203.079817:0:18943:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788930203.079818:0:18943:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788930203.079826:0:18943:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788930203.079847:0:18943:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788930203.098460:0:18943:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788930203.098637:0:18943:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788930203.100460:0:18943:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788930203.100654:0:18943:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788930203.103769:0:18943:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788930203.105816:0:18943:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788930203.111126:0:18943:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788930203.111589:0:18943:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788930203.112041:0:18943:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788930203.112342:0:18943:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788930203.112643:0:18943:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788930203.112821:0:18943:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1788930203.162662:0:18943:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967527 00000040:01000000:0.0:1788930203.166196:0:18943:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788930203.166389:0:18998:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967527 00000020:00080000:3.0:1788930203.166393:0:18998:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000040:01000000:3.0:1788930203.166857:0:18999:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788930203.166966:0:18999:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788930203.170463:0:18999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:01000000:0.0:1788930203.172250:0:18943:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788930203.172380:0:18943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788930203.172774:0:18943:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788930203.172782:0:18943:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788930203.172903:0:18943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788930203.174145:0:18999:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788930203.174154:0:18999:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1788930203.175375:0:18943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788930203.176466:0:18943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788930203.176587:0:18943:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788930203.178110:0:18943:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1788930203.184578:0:18943:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:1.0:1788930203.205760:0:18943:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1788930203.267536:0:18943:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788930203.267576:0:18943:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa545c191b988 00100000:10000000:2.0:1788930203.267586:0:18943:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788930203.273012:0:18943:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788930203.280170:0:18943:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.140@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788930203.280217:0:18943:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788930203.280623:0:18943:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788930203.494633:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788930203.995572:0:18994:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788930203.995582:0:18994:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788930203.995974:0:18994:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788930203.995981:0:18994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:1.0:1788930204.195052:0:18958:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788930204.195062:0:18958:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2e863d1000 from 9 10000000:01000000:1.0:1788930204.195067:0:18958:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788930204.195123:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d86a74800/0xce4472dd2237e143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930204.195211:0:18958:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2d86a74800/0xce4472dd2237e143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930204.195395:0:18958:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2d86a74800/0xce4472dd2237e143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930204.195431:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770201984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788930204.195991:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930204.196063:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e886a63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788930204.196676:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770201984 00000100:00100000:2.0:1788930204.196687:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770201984 00000100:00100000:2.0:1788930204.196747:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788930204.196758:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+11:18958:x1875828770201984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788930204.196775:0:18955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930204.196801:0:18955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2e99784800/0xce4472dd2237e14a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237e143 expref: -99 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930204.196829:0:18955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2e99784800/0xce4472dd2237e14a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237e143 expref: 12 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930204.196842:0:18955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2e99784800/0xce4472dd2237e14a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e143 expref: 12 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930204.196875:0:18955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2e99784800, rc 0) 00000100:00100000:2.0:1788930204.196950:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:18958:x1875828770201984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930204.196956:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788930204.197313:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770201984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788930204.197334:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2d86a74800/0xce4472dd2237e143 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e14a expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930204.197345:0:18958:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2d86a74800/0xce4472dd2237e143 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237e14a expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930204.197419:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770202112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788930204.197460:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930204.197493:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87cbc180 going to sleep for 11 seconds 00000100:00100000:2.0:1788930204.198724:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770202112 00000100:00100000:2.0:1788930204.198739:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770202112 00000100:00100000:2.0:1788930204.198793:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788930204.198802:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:18958:x1875828770202112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788930204.198824:0:18954:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788930204.198842:0:18954:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788930204.198845:0:18954:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788930204.198983:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:18958:x1875828770202112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 181us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930204.198992:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788930204.199297:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770202112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788930204.199355:0:18958:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788930204.199366:0:18958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d86a74800/0xce4472dd2237e143 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e14a expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930204.199376:0:18958:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2d86a74800/0xce4472dd2237e143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e14a expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930204.528309:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788930205.020243:0:18994:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788930205.020252:0:18994:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788930205.020910:0:18994:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1788930205.020970:0:18994:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788930205.021001:0:18994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:0.0:1788930205.541285:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930206.556372:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930207.582470:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788930208.224327:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788930208.224334:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788930208.224336:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788930208.224346:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788930208.224349:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788930208.224352:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788930208.224356:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d2e88731800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788930208.224386:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d2e88731800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1788930208.224409:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2e9837dc00 x1875828770202368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788930208.225884:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875828770202368:0@lo:38:kworker.0 00000100:00100000:2.0:1788930208.225982:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930208.226320:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c52ce1e4-e465-4485-9875-0a24e445f9ec:3309:1875828770202240:0@lo:400:kworker.0 00000100:00100000:3.0:1788930208.226728:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930208.226841:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770202240 00000100:00100000:2.0:1788930208.226850:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770202240 00000100:00100000:2.0:1788930208.226898:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788930208.226907:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:3309:x1875828770202240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930208.226974:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:3309:x1875828770202240:12345-0@lo:400:kworker.0 Request processed in 68us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930208.226981:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788930208.227682:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c52ce1e4-e465-4485-9875-0a24e445f9ec:3309:1875828770202240:0@lo:400:kworker.0 00000100:00100000:1.0:1788930208.232626:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770202368 00000100:00100000:1.0:1788930208.232642:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770202368 00000100:00100000:1.0:1788930208.232693:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788930208.232702:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875828770202368:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788930208.232732:0:18963:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 593 last 0 00000020:00000080:1.0:1788930208.232768:0:18963:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xce4472dd2237e151 00000004:00100000:1.0:1788930208.232785:0:18963:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788930208.232929:0:18963:0:(import.c:65:import_set_state_nolock()) ffff8d2eb5350000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788930208.233036:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875828770202368:12345-0@lo:38:kworker.0 Request processed in 335us (7053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930208.233043:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788930208.233107:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2e9837dc00 x1875828770202368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788930218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788930208.233124:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788930208.233132:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788930208.233137:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788930208.233140:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e88731800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788930208.233146:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875828770202368:0@lo:38:kworker.0 00000001:02000400:3.0:1788930208.398219:0:19242:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788930208.607781:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930209.627324:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930210.651681:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788930211.548933:0:19393:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb7e095f0 20000000:00000080:3.0:1788930211.548956:0:19393:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d2e876c8c00 uarg=0000000000000000 20000000:01000000:3.0:1788930211.548996:0:19393:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788930211.549004:0:19393:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788930211.549019:0:19393:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788930211.550321:0:19394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788930211.550680:0:19393:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788930211.557118:0:19393:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788930211.557181:0:19393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e158 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930211.557997:0:19393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e119 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e112 expref: 11 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930211.558010:0:19393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e158 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930211.558062:0:19393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e119 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237e112 expref: 11 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930211.558079:0:19393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e119 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237e112 expref: 11 pid: 18956 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930211.558095:0:19393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19393:1875828770202496:0@lo:104: 00000100:00100000:1.0:1788930211.558160:0:19393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930211.558219:0:19393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e90286d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788930211.560775:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770202496 00000100:00100000:2.0:1788930211.560804:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770202496 00000100:00100000:2.0:1788930211.560876:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788930211.560900:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c52ce1e4-e465-4485-9875-0a24e445f9ec+3:19393:x1875828770202496:12345-0@lo:104: 00010000:00010000:2.0:1788930211.560920:0:18945:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8400/0xce4472dd2237e112 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237e119 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930211.561023:0:18945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788930211.561030:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c52ce1e4-e465-4485-9875-0a24e445f9ec+3:19393:x1875828770202496:12345-0@lo:104: Request processed in 146us (2870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930211.561038:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788930211.561063:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930211.561070:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8400/0xce4472dd2237e112 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237e119 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930211.561078:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8400 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:2.0:1788930211.561082:0:18949:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8400/0xce4472dd2237e112 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237e119 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930211.561093:0:18949:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8400/0xce4472dd2237e112 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237e119 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788930211.561101:0:18949:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8400/0xce4472dd2237e112 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237e119 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930211.561107:0:18949:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788930211.561144:0:18949:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8400/0xce4472dd2237e112 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e119 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930211.561151:0:18949:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788930211.561174:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8400/0xce4472dd2237e112 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e119 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930211.561187:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8400/0xce4472dd2237e112 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e119 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930211.561209:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930211.561211:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930211.561212:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788930211.561269:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c52ce1e4-e465-4485-9875-0a24e445f9ec:3310:1875828770202624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788930211.561311:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930211.561683:0:19393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19393:1875828770202496:0@lo:104: 00010000:00010000:0.0:1788930211.561705:0:19393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e158 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930211.562171:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770202624 00000100:00100000:2.0:1788930211.562177:0:18946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770202624 00010000:00010000:2.0:1788930211.562202:0:18946:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e119 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237e112 expref: 12 pid: 18956 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930211.562814:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788930211.562827:0:18946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:3310:x1875828770202624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788930211.562845:0:18946:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788930211.562853:0:18946:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e119 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237e112 expref: 12 pid: 18956 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930211.562865:0:18946:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e119 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237e112 expref: 12 pid: 18956 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930211.562893:0:18946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e119 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237e112 expref: 12 pid: 18956 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930211.562911:0:18946:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e158 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930211.562937:0:18946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e158 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930211.562953:0:18946:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e158 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930211.562961:0:18946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e158 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930211.562968:0:18946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e158 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930211.562976:0:18946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e158 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930211.562981:0:18946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a75800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930211.562986:0:18946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e158 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930211.562994:0:18946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e158 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930211.563014:0:18946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e158 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930211.563026:0:18946:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788930211.563088:0:18946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c52ce1e4-e465-4485-9875-0a24e445f9ec+11:3310:x1875828770202624:12345-0@lo:103:ldlm_bl.0 Request processed in 265us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930211.563096:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788930211.563172:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c52ce1e4-e465-4485-9875-0a24e445f9ec:3310:1875828770202624:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788930211.563310:0:19393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e158 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930211.563320:0:19393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e158 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930211.563326:0:19393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e158 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930211.677387:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930212.315635:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788930202/real 1788930202] req@ffff8d2e9837c700 x1875828770199680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788930212 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788930212.315667:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2e9837c700 x1875828770199680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788930212 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788930212.315676:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788930202/real 1788930202] req@ffff8d2e9837d180 x1875828770199424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788930212 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788930212.315723:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2e9837d180 x1875828770199424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788930212 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788930212.315748:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e986b1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788930212.315777:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788930212.315780:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770199680:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788930212.315786:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2eb7298000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788930212.315792:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788930212.315795:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770199424:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788930212.315960:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788930212.315971:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788930212.315974:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d2eb7298000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788930212.315979:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 588 00000100:00080000:2.0:1788930212.315984:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788930212.315996:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d2eb7298000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1788930212.316018:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d85134a80 x1875828770202880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788930212.316027:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788930212.316030:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788930212.316032:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d2e986b1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788930212.316035:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 588 00000100:00080000:2.0:1788930212.316038:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788930212.316041:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2e986b1000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1788930212.316051:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d85135880 x1875828770203008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788930212.316089:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788930212.316101:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c52ce1e4-e465-4485-9875-0a24e445f9ec:3310:1875828770202752:0@lo:400:kworker.0 00000100:00100000:2.0:1788930212.316180:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930212.316249:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770202880:0@lo:8:kworker.0 00000100:00100000:2.0:1788930212.316250:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770203136:0@lo:400:kworker.0 00000400:00000100:1.0:1788930212.316279:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875828770202880 offset 0 length 520: 4 00000100:00100000:2.0:1788930212.316285:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930212.316293:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770203008:0@lo:8:kworker.0 00000400:00000100:1.0:1788930212.316312:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875828770203008 offset 0 length 520: 4 00000100:00100000:2.0:1788930212.316320:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770202752 00000100:00100000:2.0:1788930212.316327:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770202752 00000100:00100000:2.0:1788930212.316367:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788930212.316376:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+11:3310:x1875828770202752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930212.318256:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770203136 00000100:00100000:0.0:1788930212.318269:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770203136 00000100:00100000:0.0:1788930212.318328:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788930212.318338:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770203136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930212.320437:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+11:3310:x1875828770202752:12345-0@lo:400:kworker.0 Request processed in 4050us (4245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930212.320468:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788930212.320490:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c52ce1e4-e465-4485-9875-0a24e445f9ec:3310:1875828770202752:0@lo:400:kworker.0 00000100:00100000:0.0:1788930212.321289:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770203136:12345-0@lo:400:kworker.0 Request processed in 2948us (4997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930212.321299:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788930212.321356:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2d85137800 x1875828770203136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930212.321370:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770203136:0@lo:400:kworker.0 00010000:00010000:2.0:1788930212.699328:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788930212.955490:0:18958:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788930212.955501:0:18958:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2e863d1000 from 10 10000000:01000000:2.0:1788930212.955507:0:18958:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788930212.955571:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237e15f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930212.955584:0:18958:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237e15f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930212.955609:0:18958:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237e15f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930212.955643:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85137800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770203264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788930212.955727:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930212.955798:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98309180 going to sleep for 11 seconds 00000100:00100000:3.0:1788930212.955813:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770203264 00000100:00100000:3.0:1788930212.955823:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770203264 00000100:00100000:3.0:1788930212.955892:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788930212.955902:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+11:18958:x1875828770203264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788930212.955917:0:18954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930212.955934:0:18954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc597800/0xce4472dd2237e166 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237e15f expref: -99 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930212.955972:0:18954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc597800/0xce4472dd2237e166 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237e15f expref: 12 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930212.955984:0:18954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc597800/0xce4472dd2237e166 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e15f expref: 12 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930212.955992:0:18954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597800, rc 0) 00000100:00100000:3.0:1788930212.956042:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:18958:x1875828770203264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930212.956049:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788930212.956420:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85137800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770203264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788930212.956437:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237e15f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e166 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930212.956447:0:18958:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237e15f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237e166 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930212.956508:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85137800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770203392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788930212.957126:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930212.957258:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98309180 going to sleep for 11 seconds 00000100:00100000:0.0:1788930212.957401:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770203392 00000100:00100000:0.0:1788930212.957408:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770203392 00000100:00100000:1.0:1788930212.957763:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788930212.957775:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:18958:x1875828770203392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788930212.958109:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:18958:x1875828770203392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 335us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930212.958117:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788930212.958211:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85137800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770203392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788930212.958283:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85137800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770203520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788930212.958330:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930212.959096:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98309180 going to sleep for 11 seconds 00000100:00100000:3.0:1788930212.959197:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770203520 00000100:00100000:3.0:1788930212.959204:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770203520 00000100:00100000:3.0:1788930212.959312:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788930212.959322:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:18958:x1875828770203520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788930212.959571:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:18958:x1875828770203520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930212.959580:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788930212.959982:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85137800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770203520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788930212.961772:0:19455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788930212.965445:0:18958:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788930212.965491:0:18958:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788930212.965503:0:18958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237e15f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e166 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930212.965516:0:18958:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237e15f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e166 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930213.726468:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930214.749445:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788930215.263845:0:18994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788930215.772687:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788930216.797592:0:19643:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788930216.797597:0:19643:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788930216.797712:0:19643:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d2eb5425800 00000020:01000004:2.0:1788930216.797728:0:19643:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788930216.797740:0:19643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788930216.797754:0:19643:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d2e881e0000) 00000020:00000080:2.0:1788930216.797768:0:19643:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00010000:00010000:3.0:1788930216.802361:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788930216.828493:0:19643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788930216.831438:0:19643:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788930216.836559:0:19643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788930216.837295:0:19643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788930216.837595:0:19643:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:0.0:1788930216.838579:0:19643:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 575: rc = 0 00100000:10000000:0.0:1788930216.838676:0:19643:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 575: rc = 0 00100000:10000000:0.0:1788930216.838764:0:19643:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 575: rc = 0 00100000:10000000:0.0:1788930216.840382:0:19643:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 423: rc = 0 00100000:10000000:0.0:1788930216.840759:0:19643:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 423: rc = 0 00100000:10000000:0.0:1788930216.844734:0:19643:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 423: rc = 0 00100000:10000000:0.0:1788930216.845736:0:19643:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 423: rc = 0 00100000:10000000:0.0:1788930216.846045:0:19643:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 423: rc = 0 00100000:10000000:0.0:1788930216.846330:0:19643:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 423: rc = 0 00000020:00000080:0.0:1788930216.848450:0:19643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788930216.848463:0:19643:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788930216.848478:0:19643:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xce4472dd2237e174 00000020:01000004:0.0:1788930216.848488:0:19643:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788930216.848510:0:19643:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.140@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788930216.848514:0:19643:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788930216.848521:0:19643:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788930216.848525:0:19643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788930216.848538:0:19643:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d2e87ca99c0) 00000020:00000080:0.0:1788930216.848547:0:19643:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788930216.851746:0:19643:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788930216.853714:0:19643:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788930216.853724:0:19643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788930216.856706:0:19643:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788930216.856720:0:19643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788930216.857887:0:19643:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788930216.857897:0:19643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788930216.864396:0:19643:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788930216.864605:0:19643:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788930216.864612:0:19643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788930216.873346:0:19643:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788930216.873373:0:19643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788930216.907805:0:19643:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788930216.908447:0:19643:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788930216.908457:0:19643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788930216.912538:0:19643:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788930216.912555:0:19643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788930216.913687:0:19643:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788930216.913698:0:19643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788930216.918183:0:19643:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788930216.918703:0:19643:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788930216.918716:0:19643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788930216.924183:0:19643:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788930216.924487:0:19643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788930216.992895:0:19643:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788930216.993437:0:19643:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788930216.993446:0:19643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788930216.996167:0:19643:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788930216.996183:0:19643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788930216.997041:0:19643:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788930216.997140:0:19643:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788930216.997149:0:19643:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.140@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788930217.026836:0:19643:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788930217.026890:0:19643:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.140@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788930217.026895:0:19643:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788930217.026896:0:19643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788930217.026898:0:19643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788930217.026899:0:19643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788930217.026901:0:19643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788930217.026902:0:19643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788930217.026903:0:19643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788930217.026909:0:19643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788930217.026911:0:19643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788930217.026915:0:19643:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788930217.026917:0:19643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788930217.026919:0:19643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788930217.026920:0:19643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788930217.026921:0:19643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788930217.026922:0:19643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788930217.026923:0:19643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788930217.026924:0:19643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788930217.026925:0:19643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788930217.026926:0:19643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788930217.026956:0:19643:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788930217.026981:0:19643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770203648:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788930217.027208:0:19643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930217.027548:0:19643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2ebc28d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788930217.027632:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770203648 00000100:00100000:3.0:1788930217.027639:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770203648 00000100:00100000:3.0:1788930217.027837:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788930217.027848:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:19643:x1875828770203648:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788930217.027893:0:18954:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788930217.027896:0:18954:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788930217.027900:0:18954:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788930217.035466:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:19643:x1875828770203648:12345-0@lo:253:mount.lustre.0 Request processed in 7610us (8248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930217.035501:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788930217.035883:0:19643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770203648:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788930217.035905:0:19643:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788930217.035909:0:19643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788930217.035911:0:19643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788930217.035912:0:19643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788930217.035914:0:19643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788930217.035922:0:19643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788930217.035923:0:19643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788930217.035925:0:19643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788930217.035927:0:19643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788930217.035928:0:19643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788930217.035949:0:19643:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2eb5425800 from lustre-OST0000 10000000:01000000:2.0:1788930217.035977:0:19643:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788930217.035981:0:19643:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788930217.035989:0:19643:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d2eafc999c0 local copy 00010000:00010000:2.0:1788930217.036003:0:19643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8000/0xce4472dd2237e06a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e071 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930217.036340:0:19643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770203776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788930217.036452:0:19643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930217.036545:0:19643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2ebc28dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788930217.036590:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770203776 00000100:00100000:0.0:1788930217.036597:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770203776 00000100:00100000:0.0:1788930217.036767:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788930217.036788:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:19643:x1875828770203776:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930217.037003:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:19643:x1875828770203776:12345-0@lo:501:mount.lustre.0 Request processed in 225us (550us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788930217.037012:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788930217.037112:0:19643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770203776:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788930217.037128:0:19643:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788930217.037385:0:19643:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788930217.037393:0:19643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8000/0xce4472dd2237e06a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e071 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930217.037404:0:19643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8000/0xce4472dd2237e06a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e071 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930217.037433:0:19643:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2eb5425800 10000000:01000000:2.0:1788930217.037438:0:19643:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788930217.037443:0:19643:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d2eafc999c0 10000000:01000000:2.0:1788930217.037445:0:19643:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788930217.037449:0:19643:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d2eafc999c0 from 1 10000000:01000000:2.0:1788930217.037451:0:19643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788930217.037479:0:19643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99785000/0xce4472dd2237e182 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930217.037495:0:19643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e99785000/0xce4472dd2237e182 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930217.037505:0:19643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e99785000/0xce4472dd2237e182 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930217.037523:0:19643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770203904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788930217.037556:0:19643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930217.037591:0:19643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2ebc28dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788930217.037761:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770203904 00000100:00100000:3.0:1788930217.037767:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770203904 00000100:00100000:3.0:1788930217.037815:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788930217.037824:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+12:19643:x1875828770203904:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788930217.037836:0:18954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930217.037852:0:18954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc597e00/0xce4472dd2237e189 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237e182 expref: -99 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930217.037876:0:18954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc597e00/0xce4472dd2237e189 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237e182 expref: 13 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930217.037900:0:18954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc597e00/0xce4472dd2237e189 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e182 expref: 13 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930217.037909:0:18954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597e00, rc 0) 00000100:00100000:3.0:1788930217.037949:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+13:19643:x1875828770203904:12345-0@lo:101:mount.lustre.0 Request processed in 126us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930217.037955:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788930217.038075:0:19643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770203904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788930217.038090:0:19643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e99785000/0xce4472dd2237e182 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e189 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930217.038098:0:19643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e99785000/0xce4472dd2237e182 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237e189 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930217.038116:0:19643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788930217.038173:0:19643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99785000/0xce4472dd2237e182 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e189 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930217.038182:0:19643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e99785000/0xce4472dd2237e182 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e189 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930217.038189:0:19643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788930217.038193:0:19643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788930217.038198:0:19643:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788930217.038200:0:19643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788930217.038256:0:19643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930217.038264:0:19643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930217.038271:0:19643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930217.038286:0:19643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770204032:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788930217.038314:0:19643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930217.038342:0:19643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2ebc28dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788930217.038500:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770204032 00000100:00100000:1.0:1788930217.038506:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770204032 00000100:00100000:1.0:1788930217.038543:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788930217.038559:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+13:19643:x1875828770204032:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788930217.038568:0:18954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930217.038577:0:18954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d86a75c00/0xce4472dd2237e197 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237e190 expref: -99 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930217.038594:0:18954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d86a75c00/0xce4472dd2237e197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237e190 expref: 14 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930217.038601:0:18954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d86a75c00/0xce4472dd2237e197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e190 expref: 14 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930217.038607:0:18954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a75c00, rc 0) 00000100:00100000:1.0:1788930217.038638:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+14:19643:x1875828770204032:12345-0@lo:101:mount.lustre.0 Request processed in 80us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930217.038645:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788930217.038797:0:19643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770204032:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788930217.038809:0:19643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e190 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e197 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930217.038817:0:19643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e190 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237e197 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788930217.040377:0:19643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1788930217.041627:0:19643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788930217.041917:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788930217.041967:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788930217.042002:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788930217.042053:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788930217.042093:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788930217.042125:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788930217.042176:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788930217.042213:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788930217.042288:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788930217.042474:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788930217.042514:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1788930217.042571:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1788930217.042630:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1788930217.042637:0:19643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1788930217.042731:0:19643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770204160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788930217.042808:0:19643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930217.042854:0:19643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2ebc28d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788930217.042986:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770204160 00000100:00100000:1.0:1788930217.042993:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770204160 00000100:00100000:1.0:1788930217.043042:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788930217.043051:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+14:19643:x1875828770204160:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788930217.043592:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+14:19643:x1875828770204160:12345-0@lo:501:mount.lustre.0 Request processed in 540us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930217.043601:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788930217.043863:0:19643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770204160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788930217.043973:0:19643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770204288:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788930217.044014:0:19643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930217.044067:0:19643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9acfdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788930217.044104:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770204288 00000100:00100000:2.0:1788930217.044109:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770204288 00000100:00100000:2.0:1788930217.044166:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788930217.044174:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+14:19643:x1875828770204288:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788930217.044680:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+14:19643:x1875828770204288:12345-0@lo:503:mount.lustre.0 Request processed in 506us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930217.044688:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788930217.044765:0:19643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770204288:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788930217.045558:0:19643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788930217.045638:0:19643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770204416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788930217.045691:0:19643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930217.046661:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770204416 00000100:00100000:1.0:1788930217.046670:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770204416 00000100:00100000:1.0:1788930217.046709:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788930217.046730:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+14:19643:x1875828770204416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788930217.046990:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+14:19643:x1875828770204416:12345-0@lo:502:mount.lustre.0 Request processed in 260us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930217.046997:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788930217.047165:0:19643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86352540 going to sleep for 11 seconds 00000100:00100000:0.0:1788930217.047190:0:19643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770204416:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788930217.048508:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788930217.048580:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788930217.048617:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788930217.048854:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788930217.048897:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788930217.048934:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788930217.048984:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788930217.049022:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788930217.049058:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1788930217.049108:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1788930217.049145:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1788930217.049194:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1788930217.051186:0:19643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770204544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788930217.051762:0:19643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930217.051856:0:19643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9810b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788930217.053640:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770204544 00000100:00100000:3.0:1788930217.053816:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770204544 00000100:00100000:3.0:1788930217.053906:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788930217.053918:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84570c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+14:19643:x1875828770204544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788930217.054857:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84570c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+14:19643:x1875828770204544:12345-0@lo:502:mount.lustre.0 Request processed in 937us (3092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930217.054868:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788930217.055165:0:19643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770204544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788930217.055452:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1788930217.055468:0:19643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788930217.057067:0:19657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788930217.057078:0:19657:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788930217.057085:0:19657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930217.057087:0:19657:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788930217.057094:0:19657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788930217.057118:0:19657:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d2d84afcd40) 00000020:00000080:1.0:1788930217.057143:0:19657:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788930217.057153:0:19657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788930217.057219:0:19657:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2eb5425800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788930217.057491:0:19657:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788930217.057499:0:19657:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xce4472dd2237e1a5 00010000:00010000:1.0:1788930217.069964:0:19657:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788930217.070450:0:19657:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934598 00080000:10000000:1.0:1788930217.074940:0:19657:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1788930217.077414:0:19657:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788930217.077427:0:19657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788930217.077434:0:19657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930217.077436:0:19657:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788930217.077439:0:19657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788930217.077442:0:19657:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788930217.077444:0:19657:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788930217.077445:0:19657:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788930217.077447:0:19657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788930217.077450:0:19657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930217.077451:0:19657:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788930217.077453:0:19657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788930217.077456:0:19657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930217.077457:0:19657:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788930217.077460:0:19657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788930217.077463:0:19657:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788930217.077465:0:19657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788930217.077467:0:19657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930217.077469:0:19657:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788930217.077471:0:19657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788930217.077473:0:19657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930217.077475:0:19657:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788930217.077478:0:19657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788930217.077537:0:19657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788930217.077540:0:19657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788930217.077541:0:19657:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788930217.077544:0:19657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788930217.077983:0:19643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788930217.078015:0:19643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788930217.078031:0:19643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e190 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e197 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930217.078043:0:19643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e99784c00/0xce4472dd2237e190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e197 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930217.078050:0:19643:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2eb5425800 from 1 10000000:01000000:2.0:1788930217.078053:0:19643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788930217.078102:0:19643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237e1ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930217.078110:0:19643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237e1ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930217.078179:0:19643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237e1ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930217.078207:0:19643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85134700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770204672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788930217.078310:0:19643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930217.078364:0:19643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2ebc28d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788930217.078935:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770204672 00000100:00100000:1.0:1788930217.078944:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770204672 00000100:00100000:1.0:1788930217.078983:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788930217.078991:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+14:19643:x1875828770204672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788930217.079003:0:18956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930217.079017:0:18956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d86a75a00/0xce4472dd2237e1b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237e1ac expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930217.079040:0:18956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d86a75a00/0xce4472dd2237e1b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237e1ac expref: 15 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930217.079049:0:18956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d86a75a00/0xce4472dd2237e1b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e1ac expref: 15 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930217.079057:0:18956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a75a00, rc 0) 00000100:00100000:1.0:1788930217.079112:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+15:19643:x1875828770204672:12345-0@lo:101:mount.lustre.0 Request processed in 122us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930217.079119:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788930217.080854:0:19643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85134700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770204672:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788930217.080886:0:19643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237e1ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e1b3 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930217.080908:0:19643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237e1ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237e1b3 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788930217.081933:0:19643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:3.0:1788930217.084603:0:19643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788930217.084967:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788930217.085490:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788930217.085553:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788930217.085907:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788930217.085941:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788930217.086297:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788930217.086344:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788930217.086675:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788930217.086771:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788930217.086791:0:19643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:3.0:1788930217.086907:0:19643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770204800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788930217.088446:0:19643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930217.088586:0:19643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e863113c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788930217.095262:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770204800 00000100:00100000:1.0:1788930217.095280:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770204800 00000100:00100000:1.0:1788930217.095347:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788930217.095368:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84573050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+15:19643:x1875828770204800:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788930217.095694:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84573050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+15:19643:x1875828770204800:12345-0@lo:501:mount.lustre.0 Request processed in 337us (7250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930217.095703:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788930217.095763:0:19643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770204800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788930217.095838:0:19643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770204928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788930217.095903:0:19643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930217.095935:0:19643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d810853c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788930217.101732:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770204928 00000100:00100000:2.0:1788930217.101747:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770204928 00000100:00100000:2.0:1788930217.101813:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788930217.101825:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84570450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+15:19643:x1875828770204928:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788930217.102091:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84570450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+15:19643:x1875828770204928:12345-0@lo:503:mount.lustre.0 Request processed in 269us (6188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930217.102099:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788930217.102455:0:19643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770204928:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788930217.103022:0:19643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788930217.105637:0:19643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770205056:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788930217.105740:0:19643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930217.105839:0:19643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311240 going to sleep for 11 seconds 00000100:00100000:2.0:1788930217.110148:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770205056 00000100:00100000:2.0:1788930217.110167:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770205056 00000100:00100000:2.0:1788930217.110544:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788930217.110558:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+15:19643:x1875828770205056:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788930217.110908:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+15:19643:x1875828770205056:12345-0@lo:502:mount.lustre.0 Request processed in 352us (5167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930217.110924:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788930217.111028:0:19643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770205056:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788930217.111411:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788930217.111477:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788930217.111532:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788930217.111570:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788930217.111604:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788930217.111653:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788930217.111692:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788930217.111725:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:0.0:1788930217.111770:0:19643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770205184:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930217.111842:0:19643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930217.115260:0:19643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e886a66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788930217.115521:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770205184 00000100:00100000:3.0:1788930217.115532:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770205184 00000100:00100000:3.0:1788930217.115589:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788930217.115597:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+15:19643:x1875828770205184:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788930217.115883:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+15:19643:x1875828770205184:12345-0@lo:502:mount.lustre.0 Request processed in 285us (4040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930217.115892:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788930217.116338:0:19643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770205184:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788930217.116539:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788930217.116558:0:19643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788930217.118588:0:19661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788930217.118606:0:19661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930217.118609:0:19661:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788930217.118615:0:19661:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2eb5425800 00000020:00000080:0.0:1788930217.118617:0:19661:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788930217.118625:0:19661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788930217.118627:0:19661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930217.118628:0:19661:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788930217.118631:0:19661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788930217.118633:0:19661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930217.118634:0:19661:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788930217.118637:0:19661:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2eb5425800 00000020:00000080:0.0:1788930217.118639:0:19661:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788930217.118697:0:19661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788930217.118700:0:19661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930217.118702:0:19661:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788930217.118704:0:19661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788930217.118707:0:19661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930217.118708:0:19661:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788930217.118742:0:19661:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2eb5425800 00000020:00000080:0.0:1788930217.118745:0:19661:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788930217.118848:0:19661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788930217.118852:0:19661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788930217.118853:0:19661:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788930217.118856:0:19661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:0.0:1788930217.118904:0:19643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788930217.118928:0:19643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788930217.118944:0:19643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237e1ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e1b3 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930217.119026:0:19643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237e1ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e1b3 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788930217.119148:0:19643:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788930217.119157:0:19643:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2eb5425800 10000000:01000000:0.0:1788930217.119160:0:19643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2eb5425800 10000000:01000000:0.0:1788930217.119163:0:19643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788930217.119169:0:19643:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2eb5425800 from 1 10000000:01000000:0.0:1788930217.119171:0:19643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788930217.119209:0:19643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8e00/0xce4472dd2237e1ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930217.119217:0:19643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8e00/0xce4472dd2237e1ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930217.119256:0:19643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8e00/0xce4472dd2237e1ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930217.119494:0:19643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770205312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788930217.119568:0:19643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930217.119611:0:19643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e886a6840 going to sleep for 11 seconds 00000100:00100000:3.0:1788930217.119773:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770205312 00000100:00100000:3.0:1788930217.119791:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770205312 00000100:00100000:3.0:1788930217.119839:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788930217.119847:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+15:19643:x1875828770205312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788930217.119864:0:18956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930217.119878:0:18956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc597600/0xce4472dd2237e1c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237e1ba expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930217.119919:0:18956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc597600/0xce4472dd2237e1c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237e1ba expref: 16 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930217.119931:0:18956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc597600/0xce4472dd2237e1c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e1ba expref: 16 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930217.119940:0:18956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597600, rc 0) 00000100:00100000:3.0:1788930217.119979:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:19643:x1875828770205312:12345-0@lo:101:mount.lustre.0 Request processed in 132us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930217.119986:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788930217.120183:0:19643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770205312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788930217.120201:0:19643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8e00/0xce4472dd2237e1ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e1c1 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930217.120211:0:19643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8e00/0xce4472dd2237e1ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237e1c1 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788930217.124520:0:19643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:0.0:1788930217.125043:0:19643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788930217.129700:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788930217.129801:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788930217.129838:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788930217.129886:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788930217.129938:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788930217.132431:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788930217.132539:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788930217.132567:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788930217.132611:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788930217.132640:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788930217.132687:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788930217.132731:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788930217.132760:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788930217.132803:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788930217.132851:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788930217.132885:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788930217.132914:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788930217.132956:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788930217.132987:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788930217.133016:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788930217.133791:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788930217.133859:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788930217.133891:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788930217.133952:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788930217.134002:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:0.0:1788930217.134037:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:0.0:1788930217.134554:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:0.0:1788930217.134597:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:0.0:1788930217.134633:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:0.0:1788930217.134679:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:0.0:1788930217.134715:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:0.0:1788930217.134752:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:0.0:1788930217.134799:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:0.0:1788930217.134849:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:0.0:1788930217.134885:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:0.0:1788930217.134956:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:0.0:1788930217.134996:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:0.0:1788930217.135044:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:0.0:1788930217.135903:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:0.0:1788930217.135960:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:0.0:1788930217.136588:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:0.0:1788930217.136598:0:19643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:0.0:1788930217.136711:0:19643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770205440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930217.136795:0:19643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930217.136844:0:19643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e886a66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788930217.139447:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770205440 00000100:00100000:3.0:1788930217.139463:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770205440 00000100:00100000:3.0:1788930217.139524:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788930217.139535:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84573c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:19643:x1875828770205440:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788930217.139859:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84573c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:19643:x1875828770205440:12345-0@lo:501:mount.lustre.0 Request processed in 326us (3063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930217.139867:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788930217.140010:0:19643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770205440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930217.140060:0:19643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770205568:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788930217.140333:0:19643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930217.140439:0:19643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e886a66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788930217.140503:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770205568 00000100:00100000:3.0:1788930217.140509:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770205568 00000100:00100000:3.0:1788930217.140575:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788930217.140583:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:19643:x1875828770205568:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788930217.140739:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:19643:x1875828770205568:12345-0@lo:503:mount.lustre.0 Request processed in 157us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930217.140746:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788930217.145526:0:19643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770205568:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788930217.146775:0:19643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788930217.147205:0:19643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770205696:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930217.147362:0:19643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930217.147409:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770205696 00000100:00100000:0.0:1788930217.147416:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770205696 00000100:00100000:0.0:1788930217.147511:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788930217.147521:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:19643:x1875828770205696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930217.147742:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:19643:x1875828770205696:12345-0@lo:502:mount.lustre.0 Request processed in 221us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930217.147749:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788930217.147828:0:19643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e886a66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788930217.147849:0:19643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770205696:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788930217.148764:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788930217.149261:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788930217.149303:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788930217.149357:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788930217.149399:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788930217.149448:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788930217.149488:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788930217.149528:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788930217.149582:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788930217.149621:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788930217.149657:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788930217.149704:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788930217.149743:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788930217.149790:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788930217.149889:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788930217.149935:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788930217.151489:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788930217.151574:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788930217.151608:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788930217.151643:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788930217.151716:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788930217.151762:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788930217.151814:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788930217.152087:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788930217.152131:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:0.0:1788930217.152167:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:0.0:1788930217.152287:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:0.0:1788930217.152327:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:0.0:1788930217.152360:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:0.0:1788930217.152407:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:0.0:1788930217.152460:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:0.0:1788930217.152495:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:0.0:1788930217.152527:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:0.0:1788930217.152581:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:0.0:1788930217.152666:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:0.0:1788930217.152744:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:0.0:1788930217.152815:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:0.0:1788930217.153547:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:0.0:1788930217.153605:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:0.0:1788930217.153639:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:0.0:1788930217.153753:0:19643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770205824:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930217.154017:0:19643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930217.154072:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770205824 00000100:00100000:0.0:1788930217.154080:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770205824 00000100:00100000:0.0:1788930217.154124:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788930217.154131:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84571450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:19643:x1875828770205824:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930217.154433:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84571450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:19643:x1875828770205824:12345-0@lo:502:mount.lustre.0 Request processed in 301us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930217.154441:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788930217.154501:0:19643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e886a66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788930217.154525:0:19643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770205824:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788930217.154604:0:19643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:0.0:1788930217.154618:0:19643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788930217.159612:0:19666:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788930217.159630:0:19666:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d2e916299c0) 00000020:00000080:3.0:1788930217.159666:0:19666:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788930217.159785:0:19666:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2eb5425800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788930217.159791:0:19666:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2eb5425800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788930217.159795:0:19666:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2eb5425800 3 00010000:00080000:0.0:1788930217.159829:0:19666:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2e9036c800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.140@tcp at head 00010000:00010000:0.0:1788930217.163691:0:19666:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788930217.163938:0:19666:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788930217.163990:0:19666:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788930217.164004:0:19666:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xce4472dd2237e1cf 00000100:00080000:0.0:1788930217.164016:0:19666:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788930217.167128:0:19666:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d2e9036c800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1788930217.167183:0:19666:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2ebbff9180 x1875828770205952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788930217.167235:0:19666:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788930217.167482:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788930217.167487:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788930217.167489:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788930217.167492:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788930217.167555:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788930217.167570:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770206080:0@lo:400:kworker.0 00000100:00100000:2.0:1788930217.167640:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930217.167695:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770206080 00000100:00100000:2.0:1788930217.167703:0:18961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770206080 00000100:00100000:2.0:1788930217.167755:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788930217.167765:0:18961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770206080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930217.167832:0:18961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770206080:12345-0@lo:400:kworker.0 Request processed in 69us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930217.167840:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788930217.167913:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2d85134700 x1875828770206080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930217.167928:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770206080:0@lo:400:kworker.0 00000040:00080000:0.0:1788930217.168993:0:19666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:0.0:1788930217.169115:0:19643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788930217.169144:0:19643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788930217.169161:0:19643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8e00/0xce4472dd2237e1ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e1c1 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930217.169172:0:19643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8e00/0xce4472dd2237e1ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e1c1 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788930217.169255:0:19643:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788930217.169258:0:19643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788930217.169260:0:19643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788930217.169261:0:19643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788930217.169262:0:19643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788930217.169264:0:19643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788930217.169265:0:19643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788930217.169267:0:19643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788930217.169269:0:19643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788930217.169273:0:19643:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788930217.169276:0:19643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788930217.169277:0:19643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788930217.169278:0:19643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788930217.169279:0:19643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788930217.169280:0:19643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788930217.169281:0:19643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788930217.169282:0:19643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788930217.169283:0:19643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788930217.169285:0:19643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788930217.169307:0:19643:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788930217.169324:0:19643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770206208:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788930217.169384:0:19643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930217.169416:0:19643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e886a6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788930217.169603:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875828770205952:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788930217.169643:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930217.169794:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770206208 00000100:00100000:3.0:1788930217.169802:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770206208 00000100:00100000:3.0:1788930217.169838:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788930217.169847:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84573450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:19643:x1875828770206208:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788930217.169874:0:18955:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788930217.169888:0:18955:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788930217.170438:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770205952 00000100:00100000:0.0:1788930217.170448:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770205952 00000100:00100000:0.0:1788930217.170480:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788930217.170485:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1875828770205952:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788930217.170513:0:18962:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 602 last 0 00000020:00000080:0.0:1788930217.170565:0:18962:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xce4472dd2237e1d6 00000004:00100000:0.0:1788930217.170581:0:18962:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788930217.170696:0:18962:0:(import.c:65:import_set_state_nolock()) ffff8d2e9036f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788930217.170757:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875828770205952:12345-0@lo:38:llog_process_th.0 Request processed in 270us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930217.170765:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788930217.171729:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d2ebbff9180 x1875828770205952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788930227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930217.171743:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788930217.171753:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1788930217.171762:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788930217.171767:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788930217.171770:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e9036c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788930217.171786:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875828770205952:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1788930217.234599:0:18955:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788930217.234616:0:18955:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788930217.234651:0:18977:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788930217.234656:0:18977:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788930217.234677:0:18977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e1dd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930217.234696:0:18977:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2e99784800/0xce4472dd2237e14a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e143 expref: 16 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930217.234704:0:18977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e1dd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930217.234743:0:18977:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2e99784800/0xce4472dd2237e14a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237e143 expref: 16 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930217.234756:0:18977:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2e99784800/0xce4472dd2237e14a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237e143 expref: 16 pid: 18955 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930217.234769:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18977:1875828770206336:0@lo:104: 00000100:00100000:3.0:1788930217.234839:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930217.234877:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311240 going to sleep for 11 seconds 00000100:00100000:3.0:1788930217.234899:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770206336 00000100:00100000:3.0:1788930217.234906:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770206336 00000100:00100000:3.0:1788930217.234958:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788930217.234965:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c52ce1e4-e465-4485-9875-0a24e445f9ec+3:18977:x1875828770206336:12345-0@lo:104: 00010000:00010000:3.0:1788930217.234977:0:18945:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2d86a74800/0xce4472dd2237e143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237e14a expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930217.235019:0:18945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788930217.235024:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c52ce1e4-e465-4485-9875-0a24e445f9ec+3:18977:x1875828770206336:12345-0@lo:104: Request processed in 60us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930217.235030:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788930217.235050:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788930217.235055:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2d86a74800/0xce4472dd2237e143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237e14a expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930217.235062:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74800 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:3.0:1788930217.235066:0:18950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2d86a74800/0xce4472dd2237e143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237e14a expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930217.235073:0:18950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2d86a74800/0xce4472dd2237e143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237e14a expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788930217.235079:0:18950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2d86a74800/0xce4472dd2237e143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237e14a expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788930217.235085:0:18950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788930217.235111:0:18950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2d86a74800/0xce4472dd2237e143 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e14a expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930217.235116:0:18950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788930217.235134:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2d86a74800/0xce4472dd2237e143 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e14a expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930217.235151:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2d86a74800/0xce4472dd2237e143 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e14a expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930217.235169:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930217.235171:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930217.235173:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788930217.235189:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c52ce1e4-e465-4485-9875-0a24e445f9ec:3310:1875828770206464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788930217.235216:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930217.236463:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18977:1875828770206336:0@lo:104: 00010000:00010000:3.0:1788930217.236487:0:18977:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e1dd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930217.236909:0:18948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770206464 00000100:00100000:1.0:1788930217.236917:0:18948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770206464 00010000:00010000:1.0:1788930217.236943:0:18948:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2e99784800/0xce4472dd2237e14a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237e143 expref: 17 pid: 18955 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930217.236973:0:18948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788930217.236981:0:18948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c52ce1e4-e465-4485-9875-0a24e445f9ec+17:3310:x1875828770206464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788930217.236993:0:18948:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930217.236998:0:18948:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2e99784800/0xce4472dd2237e14a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237e143 expref: 17 pid: 18955 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930217.237008:0:18948:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2e99784800/0xce4472dd2237e14a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237e143 expref: 17 pid: 18955 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930217.237025:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2e99784800/0xce4472dd2237e14a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237e143 expref: 17 pid: 18955 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930217.237039:0:18948:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e1dd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930217.237048:0:18948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e1dd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788930217.237063:0:18948:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002407911s 00010000:00010000:1.0:1788930217.237068:0:18948:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e1dd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930217.237086:0:18948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e1dd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930217.237093:0:18948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e1dd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930217.237100:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e1dd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930217.237105:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc597400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930217.237110:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e1dd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930217.237117:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e1dd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930217.237132:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e1dd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930217.237140:0:18948:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930217.237192:0:18948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:3310:x1875828770206464:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930217.237199:0:18948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788930217.237572:0:18977:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e1dd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930217.237582:0:18977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e1dd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930217.237589:0:18977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebc597400/0xce4472dd2237e1dd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930217.237704:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c52ce1e4-e465-4485-9875-0a24e445f9ec:3310:1875828770206464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788930217.256806:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84573450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+15:19643:x1875828770206208:12345-0@lo:253:mount.lustre.0 Request processed in 86947us (87408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930217.256825:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788930217.256913:0:19643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:19643:1875828770206208:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788930217.256931:0:19643:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788930217.256934:0:19643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788930217.256935:0:19643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788930217.256952:0:19643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788930217.256954:0:19643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788930217.256955:0:19643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788930217.256956:0:19643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788930217.256958:0:19643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788930217.256960:0:19643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788930217.256961:0:19643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788930217.256979:0:19643:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788930217.257890:0:19643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788930217.258054:0:19643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788930217.258216:0:19643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788930217.258499:0:19643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788930217.258658:0:19643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788930217.258888:0:19643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788930217.259993:0:19643:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788930217.303404:0:19643:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788930217.303417:0:19643:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788930217.303462:0:19643:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788930217.303532:0:19643:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.140@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788930217.303548:0:19643:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788930217.303580:0:19643:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788930217.819520:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930218.846632:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788930219.235031:0:18958:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788930219.235038:0:18958:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2e863d1000 from 10 10000000:01000000:0.0:1788930219.235044:0:18958:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788930219.237201:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9c00/0xce4472dd2237e1e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930219.237219:0:18958:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9c00/0xce4472dd2237e1e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930219.237248:0:18958:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9c00/0xce4472dd2237e1e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930219.237278:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770206592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788930219.237368:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930219.237419:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e93f000c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788930219.237454:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770206592 00000100:00100000:0.0:1788930219.237464:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770206592 00000100:00100000:0.0:1788930219.237525:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788930219.237535:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+15:18958:x1875828770206592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788930219.237549:0:18954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930219.237567:0:18954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebe0b9000/0xce4472dd2237e1eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237e1e4 expref: -99 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930219.237592:0:18954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebe0b9000/0xce4472dd2237e1eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237e1e4 expref: 16 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930219.237603:0:18954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebe0b9000/0xce4472dd2237e1eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e1e4 expref: 16 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930219.237612:0:18954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9000, rc 0) 00000100:00100000:0.0:1788930219.237651:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:18958:x1875828770206592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930219.237659:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788930219.237708:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770206592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788930219.237729:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9c00/0xce4472dd2237e1e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e1eb expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930219.237750:0:18958:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9c00/0xce4472dd2237e1e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237e1eb expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930219.237805:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770206720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788930219.237835:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930219.237851:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e93f000c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788930219.237863:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770206720 00000100:00100000:0.0:1788930219.237866:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770206720 00000100:00100000:0.0:1788930219.237892:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788930219.237897:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84571050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:18958:x1875828770206720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788930219.237910:0:18955:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788930219.237938:0:18955:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788930219.237942:0:18955:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788930219.238025:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84571050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:18958:x1875828770206720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930219.238032:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788930219.238163:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770206720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788930219.238220:0:18958:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788930219.238245:0:18958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9c00/0xce4472dd2237e1e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e1eb expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930219.238253:0:18958:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9c00/0xce4472dd2237e1e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e1eb expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930219.869274:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930220.908161:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930221.916657:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788930222.557988:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788930222.557995:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788930222.557998:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788930222.558001:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788930222.558042:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788930222.558065:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c52ce1e4-e465-4485-9875-0a24e445f9ec:3310:1875828770206848:0@lo:400:kworker.0 00000100:00100000:0.0:1788930222.558145:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930222.558202:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770206976:0@lo:400:kworker.0 00000100:00100000:0.0:1788930222.558258:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930222.558281:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788930222.558286:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770207104:0@lo:400:kworker.0 00000100:00100000:0.0:1788930222.558307:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930222.558338:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770206848 00000100:00100000:0.0:1788930222.558346:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770206848 00000100:00100000:0.0:1788930222.558391:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788930222.558399:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:3310:x1875828770206848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930222.558446:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:3310:x1875828770206848:12345-0@lo:400:kworker.0 Request processed in 47us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930222.558466:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788930222.558499:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770206976 00000100:00100000:0.0:1788930222.558503:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770206976 00000100:00100000:0.0:1788930222.558524:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770207104 00000100:00100000:0.0:1788930222.558526:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770207104 00000100:00100000:0.0:1788930222.558553:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788930222.558559:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770206976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930222.558597:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770206976:12345-0@lo:400:kworker.0 Request processed in 38us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930222.558604:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788930222.558615:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788930222.558622:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770207104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930222.558648:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770207104:12345-0@lo:400:kworker.0 Request processed in 28us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930222.558653:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788930222.558705:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2ebbffb100 x1875828770207104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930222.558719:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770207104:0@lo:400:kworker.0 00010000:00080000:0.0:1788930222.558730:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2ebbff8700 x1875828770206976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930222.558739:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770206976:0@lo:400:kworker.0 00000100:00100000:0.0:1788930222.558767:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c52ce1e4-e465-4485-9875-0a24e445f9ec:3310:1875828770206848:0@lo:400:kworker.0 00000100:00080000:2.0:1788930222.559279:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788930222.942952:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930223.965213:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788930224.520761:0:20010:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788930224.988185:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788930225.507817:0:18994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788930226.012410:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.052272:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930227.419373:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788930212/real 1788930212] req@ffff8d2d85134a80 x1875828770202880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788930227 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788930227.419480:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2d85134a80 x1875828770202880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788930227 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788930227.419516:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788930212/real 1788930212] req@ffff8d2d85135880 x1875828770203008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788930227 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788930227.419530:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d2d85135880 x1875828770203008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788930227 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788930227.419551:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2eb7298000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788930227.419594:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788930227.419598:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770202880:0@lo:8:kworker.0 00000100:00080000:1.0:1788930227.419604:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e986b1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788930227.419610:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788930227.419614:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770203008:0@lo:8:kworker.0 00000100:00080000:2.0:1788930227.419689:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788930227.419695:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788930227.419698:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2eb7298000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788930227.419703:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 597 00000100:00080000:2.0:1788930227.419709:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788930227.419720:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d2eb7298000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1788930227.419742:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d85135500 x1875828770207360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788930227.419761:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788930227.419764:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788930227.419772:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d2e986b1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788930227.419776:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 597 00000100:00080000:2.0:1788930227.419778:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788930227.419783:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2e986b1000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:2.0:1788930227.419795:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2d85137100 x1875828770207488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788930227.419833:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770207360:0@lo:8:kworker.0 00000100:00100000:0.0:1788930227.419895:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c52ce1e4-e465-4485-9875-0a24e445f9ec:3310:1875828770207232:0@lo:400:kworker.0 00000100:00100000:1.0:1788930227.419896:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930227.419949:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930227.419958:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770207488:0@lo:8:kworker.0 00000100:00100000:0.0:1788930227.419976:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788930227.419984:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770207616:0@lo:400:kworker.0 00000100:00100000:1.0:1788930227.419990:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930227.420023:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930227.420054:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770207744:0@lo:400:kworker.0 00000100:00100000:0.0:1788930227.420077:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930227.420108:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770207232 00000100:00100000:0.0:1788930227.420115:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770207232 00000100:00100000:0.0:1788930227.420158:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788930227.420167:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:3310:x1875828770207232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930227.420175:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770207360 00000100:00100000:1.0:1788930227.420181:0:19646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770207360 00000100:00100000:1.0:1788930227.420207:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770207488 00000100:00100000:1.0:1788930227.420210:0:19646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770207488 00000100:00100000:0.0:1788930227.420220:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:3310:x1875828770207232:12345-0@lo:400:kworker.0 Request processed in 52us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930227.420255:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788930227.420286:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770207616 00000100:00100000:0.0:1788930227.420289:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770207616 00000100:00100000:0.0:1788930227.420312:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770207744 00000100:00100000:0.0:1788930227.420314:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770207744 00000100:00100000:0.0:1788930227.420335:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788930227.420340:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770207616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930227.420370:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770207616:12345-0@lo:400:kworker.0 Request processed in 29us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930227.420375:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788930227.420386:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788930227.420391:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770207744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930227.420419:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770207744:12345-0@lo:400:kworker.0 Request processed in 28us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930227.420505:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788930227.420532:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788930227.420557:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2d85135f80 x1875828770207744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930227.420569:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770207744:0@lo:400:kworker.0 00010000:00080000:0.0:1788930227.420604:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2d85134000 x1875828770207616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930227.420612:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770207616:0@lo:400:kworker.0 00000100:00100000:1.0:1788930227.420618:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788930227.420624:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c52ce1e4-e465-4485-9875-0a24e445f9ec:3310:1875828770207232:0@lo:400:kworker.0 00000100:00100000:1.0:1788930227.420629:0:19646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875828770207360:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788930227.420659:0:19646:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 612 last 0 00000020:00000080:1.0:1788930227.420694:0:19646:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce4472dd2237e1f2 00002000:00100000:1.0:1788930227.420707:0:19646:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d2eb5449000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788930227.420719:0:19646:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788930227.420722:0:19646:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788930227.422358:0:19646:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788930227.422397:0:19646:0:(import.c:65:import_set_state_nolock()) ffff8d2eb544a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788930227.422490:0:19646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875828770207360:12345-0@lo:8:kworker.0 Request processed in 1861us (2593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930227.422499:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788930227.422526:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788930227.422532:0:19646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875828770207488:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788930227.422548:0:19646:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1788930227.422553:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2d85135500 x1875828770207360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788930247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930227.422569:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788930227.422578:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788930227.422597:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788930227.422602:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788930227.422605:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2eb7298000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788930227.422630:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788930227.422636:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770207360:0@lo:8:kworker.0 00000004:00080000:3.0:1788930227.422707:0:18983:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788930227.422951:0:18983:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 612578725762ns, next at 0ns, rc = 0 00000004:00080000:2.0:1788930227.423071:0:18984:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x22:0x0] 00000100:00100000:2.0:1788930227.423094:0:18984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18984:1875828770208000:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788930227.423138:0:18984:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930227.423159:0:18984:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2eb5b07d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788930227.423267:0:19647:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788930227.423280:0:19647:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788930227.423370:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788930227.423381:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770207872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788930227.423413:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930227.423764:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770207872 00000100:00100000:2.0:1788930227.423772:0:19648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770207872 00000100:00100000:2.0:1788930227.423819:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788930227.423827:0:19648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875828770207872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788930227.423854:0:19648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788930227.423899:0:19648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875828770207872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930227.423905:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788930227.423932:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788930227.424036:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d2d85135c00 x1875828770207872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788930243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930227.424067:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770207872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788930227.426290:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770208000 00000100:00100000:2.0:1788930227.426307:0:19647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770208000 00000100:00100000:0.0:1788930227.426822:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788930227.426835:0:20132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18984:x1875828770208000:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788930227.432938:0:20132:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788930227.432952:0:20132:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1788930227.432957:0:20132:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:65) 00000100:00100000:1.0:1788930227.446716:0:19646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875828770207488:12345-0@lo:8:kworker.0 Request processed in 24174us (26720us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788930227.446731:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788930227.447142:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e986b1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788930227.447149:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788930227.447154:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770207488:0@lo:8:kworker.0 00000004:00080000:3.0:1788930227.458938:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788930227.460272:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.460285:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011a77356/0xce4472dd2237e1f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.460304:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.460309:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.460315:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011a77356/0xce4472dd2237e1f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.460332:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011a77356/0xce4472dd2237e1f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.460343:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011a77356/0xce4472dd2237e1f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.460350:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011a77356/0xce4472dd2237e1f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.460368:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788930227.466644:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.466656:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237e200 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.466673:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.466677:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.466683:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237e200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.466697:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237e200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.466706:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237e200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.466714:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237e200 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.466733:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788930227.467155:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788930227.467164:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011a77356/0xce4472dd2237e1f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.467172:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.467177:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011a77356/0xce4472dd2237e1f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.467187:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011a77356/0xce4472dd2237e1f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.467207:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011a77356/0xce4472dd2237e1f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.467249:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011a77356/0xce4472dd2237e1f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.467269:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930227.467272:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237e200 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.467279:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.467282:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237e200 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.467289:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237e200 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.467299:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237e200 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.467306:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237e200 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.467317:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.467319:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.467320:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.467333:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788930227.467738:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.467744:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005632454f/0xce4472dd2237e207 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.467753:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.467756:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.467760:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005632454f/0xce4472dd2237e207 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.467781:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005632454f/0xce4472dd2237e207 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.467790:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005632454f/0xce4472dd2237e207 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.467797:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005632454f/0xce4472dd2237e207 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.470750:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788930227.471987:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.472002:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237e20e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.472021:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.472038:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.472050:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237e20e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.472067:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237e20e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.472078:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237e20e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.472098:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237e20e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.472967:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788930227.472980:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005632454f/0xce4472dd2237e207 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.473000:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8a00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.473004:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005632454f/0xce4472dd2237e207 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.473013:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005632454f/0xce4472dd2237e207 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.473045:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005632454f/0xce4472dd2237e207 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.473053:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005632454f/0xce4472dd2237e207 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.473077:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930227.473091:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237e20e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.473098:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.473101:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237e20e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.473109:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237e20e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.473118:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237e20e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.473132:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.473134:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.473136:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930227.477157:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788930227.477177:0:20132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc326a26/0xce4472dd2237e20e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788930227.478786:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.478798:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076fb7ebf/0xce4472dd2237e215 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.478814:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.478821:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.478826:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076fb7ebf/0xce4472dd2237e215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.478840:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076fb7ebf/0xce4472dd2237e215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.478851:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076fb7ebf/0xce4472dd2237e215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.478859:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076fb7ebf/0xce4472dd2237e215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.478888:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788930227.480159:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930227.480171:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076fb7ebf/0xce4472dd2237e215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.480183:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.480188:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076fb7ebf/0xce4472dd2237e215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.480199:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076fb7ebf/0xce4472dd2237e215 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.480236:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076fb7ebf/0xce4472dd2237e215 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.480246:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076fb7ebf/0xce4472dd2237e215 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.480266:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.480268:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.480270:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.480377:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788930227.481379:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.481389:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1faf7c8/0xce4472dd2237e21c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.481402:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.481406:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.481413:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1faf7c8/0xce4472dd2237e21c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.481427:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1faf7c8/0xce4472dd2237e21c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.481435:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1faf7c8/0xce4472dd2237e21c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.481441:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1faf7c8/0xce4472dd2237e21c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.481500:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788930227.481950:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.481956:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237e223 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.481966:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.481975:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.481980:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237e223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.481990:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237e223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.481998:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237e223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.482005:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237e223 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.483014:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788930227.483025:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1faf7c8/0xce4472dd2237e21c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.483621:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.483627:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1faf7c8/0xce4472dd2237e21c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.483638:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1faf7c8/0xce4472dd2237e21c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.483661:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1faf7c8/0xce4472dd2237e21c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.483669:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1faf7c8/0xce4472dd2237e21c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.483698:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930227.483702:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237e223 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.483708:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.483711:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237e223 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.483718:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237e223 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.483727:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237e223 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.483742:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.483744:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.483746:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930227.483925:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788930227.483933:0:20132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237e223 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788930227.484646:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.484653:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2c13f33/0xce4472dd2237e22a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.484665:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.484670:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.484676:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2c13f33/0xce4472dd2237e22a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.484689:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2c13f33/0xce4472dd2237e22a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.484708:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2c13f33/0xce4472dd2237e22a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.484716:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2c13f33/0xce4472dd2237e22a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.484861:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930227.484868:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2c13f33/0xce4472dd2237e22a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.484875:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.484878:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2c13f33/0xce4472dd2237e22a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.484887:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2c13f33/0xce4472dd2237e22a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.484899:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2c13f33/0xce4472dd2237e22a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.484908:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.484910:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.484912:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930227.484995:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788930227.485001:0:20132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2c13f33/0xce4472dd2237e22a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788930227.485475:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.485482:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3f690db/0xce4472dd2237e231 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.485491:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.485494:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.485499:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3f690db/0xce4472dd2237e231 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.485509:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3f690db/0xce4472dd2237e231 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.485518:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3f690db/0xce4472dd2237e231 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.485536:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3f690db/0xce4472dd2237e231 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.485713:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930227.485719:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3f690db/0xce4472dd2237e231 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.485727:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.485730:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3f690db/0xce4472dd2237e231 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.485746:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3f690db/0xce4472dd2237e231 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.485757:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3f690db/0xce4472dd2237e231 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.485765:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.485766:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.485768:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930227.485851:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788930227.485857:0:20132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3f690db/0xce4472dd2237e231 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.486090:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788930227.486835:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.486842:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f500ad05/0xce4472dd2237e238 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.486853:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.486856:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.486860:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f500ad05/0xce4472dd2237e238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.486871:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f500ad05/0xce4472dd2237e238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.486880:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f500ad05/0xce4472dd2237e238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.486887:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f500ad05/0xce4472dd2237e238 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.486954:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788930227.488539:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.488550:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005522f80f/0xce4472dd2237e23f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.488565:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.488569:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.488574:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005522f80f/0xce4472dd2237e23f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.489345:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005522f80f/0xce4472dd2237e23f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.489363:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005522f80f/0xce4472dd2237e23f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.489372:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005522f80f/0xce4472dd2237e23f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.489429:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788930227.489438:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f500ad05/0xce4472dd2237e238 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.489446:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8c00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.489450:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f500ad05/0xce4472dd2237e238 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.489460:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f500ad05/0xce4472dd2237e238 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.489476:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f500ad05/0xce4472dd2237e238 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.489484:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f500ad05/0xce4472dd2237e238 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.489521:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930227.489525:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005522f80f/0xce4472dd2237e23f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.489532:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.489534:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005522f80f/0xce4472dd2237e23f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.489542:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005522f80f/0xce4472dd2237e23f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.489553:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005522f80f/0xce4472dd2237e23f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.489560:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.489561:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.489563:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930227.489704:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788930227.489710:0:20132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005522f80f/0xce4472dd2237e23f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788930227.490359:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.490366:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093888c0b/0xce4472dd2237e246 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.490383:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.490387:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.490392:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093888c0b/0xce4472dd2237e246 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.490403:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093888c0b/0xce4472dd2237e246 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.490413:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093888c0b/0xce4472dd2237e246 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.490421:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093888c0b/0xce4472dd2237e246 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.495079:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930227.495095:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093888c0b/0xce4472dd2237e246 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.495129:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152e00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930227.495135:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093888c0b/0xce4472dd2237e246 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.495147:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093888c0b/0xce4472dd2237e246 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.495170:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093888c0b/0xce4472dd2237e246 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.495180:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930227.495182:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930227.495185:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930227.495822:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788930227.495832:0:20132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093888c0b/0xce4472dd2237e246 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.496467:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788930227.497541:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.497552:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000541134b5/0xce4472dd2237e24d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.497575:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.497580:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.497595:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000541134b5/0xce4472dd2237e24d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.497624:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000541134b5/0xce4472dd2237e24d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.497636:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000541134b5/0xce4472dd2237e24d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.497644:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000541134b5/0xce4472dd2237e24d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.498181:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788930227.498813:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.498822:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237e254 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.498836:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.498840:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.498845:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237e254 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.498856:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237e254 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.498866:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237e254 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.498886:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237e254 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.499138:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788930227.499147:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000541134b5/0xce4472dd2237e24d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.499157:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2153800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930227.499161:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000541134b5/0xce4472dd2237e24d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.499172:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000541134b5/0xce4472dd2237e24d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.499190:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000541134b5/0xce4472dd2237e24d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.499206:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000541134b5/0xce4472dd2237e24d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.499250:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930227.499254:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237e254 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.499261:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930227.499264:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237e254 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.499271:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237e254 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.499282:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237e254 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.499290:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930227.499292:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930227.499293:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930227.501890:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788930227.501905:0:20132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237e254 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788930227.502898:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.502906:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000811c9ade/0xce4472dd2237e25b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.502921:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.502926:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.502932:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000811c9ade/0xce4472dd2237e25b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.502948:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000811c9ade/0xce4472dd2237e25b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.502959:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000811c9ade/0xce4472dd2237e25b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.502969:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000811c9ade/0xce4472dd2237e25b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.503267:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788930227.503782:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.503789:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093888c0b/0xce4472dd2237e262 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.503800:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.503803:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.503808:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093888c0b/0xce4472dd2237e262 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.503819:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093888c0b/0xce4472dd2237e262 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.503828:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093888c0b/0xce4472dd2237e262 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.503835:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093888c0b/0xce4472dd2237e262 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.504973:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788930227.504985:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000811c9ade/0xce4472dd2237e25b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.504997:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2153c00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.505001:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000811c9ade/0xce4472dd2237e25b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.505023:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000811c9ade/0xce4472dd2237e25b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.505041:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000811c9ade/0xce4472dd2237e25b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.505049:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000811c9ade/0xce4472dd2237e25b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.505065:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930227.505069:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093888c0b/0xce4472dd2237e262 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.505075:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152e00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.505078:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093888c0b/0xce4472dd2237e262 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.505086:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093888c0b/0xce4472dd2237e262 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.505093:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093888c0b/0xce4472dd2237e262 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.505100:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.505101:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.505106:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930227.507244:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788930227.507256:0:20132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093888c0b/0xce4472dd2237e262 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788930227.507937:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.507944:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005522f80f/0xce4472dd2237e269 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.507968:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.507973:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.507979:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005522f80f/0xce4472dd2237e269 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.507994:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005522f80f/0xce4472dd2237e269 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.508004:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005522f80f/0xce4472dd2237e269 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.508012:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005522f80f/0xce4472dd2237e269 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.508022:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788930227.508379:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.508385:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9f66236/0xce4472dd2237e270 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.508392:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.508396:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.508400:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9f66236/0xce4472dd2237e270 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.508409:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9f66236/0xce4472dd2237e270 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.508426:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9f66236/0xce4472dd2237e270 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.508434:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9f66236/0xce4472dd2237e270 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.508442:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788930227.508672:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788930227.508679:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005522f80f/0xce4472dd2237e269 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.508688:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.508693:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005522f80f/0xce4472dd2237e269 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.508702:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005522f80f/0xce4472dd2237e269 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.508717:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005522f80f/0xce4472dd2237e269 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.508724:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005522f80f/0xce4472dd2237e269 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.508739:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930227.508743:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9f66236/0xce4472dd2237e270 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.508749:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152a00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.508752:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9f66236/0xce4472dd2237e270 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.508759:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9f66236/0xce4472dd2237e270 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.508774:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9f66236/0xce4472dd2237e270 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.508781:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9f66236/0xce4472dd2237e270 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.508792:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.508794:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.508795:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930227.508903:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788930227.509996:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.510006:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237e277 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.510018:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.510022:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.510027:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237e277 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.510039:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237e277 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.510049:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237e277 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.510057:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237e277 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.510093:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788930227.511692:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930227.511706:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237e277 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.511717:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152c00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.511721:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237e277 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.511732:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237e277 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.511751:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237e277 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.511758:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000681b8142/0xce4472dd2237e277 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.511793:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.511795:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.511797:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788930227.512354:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.512361:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237e27e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.512372:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.512376:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.512381:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237e27e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.512392:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237e27e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.512401:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237e27e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.512409:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237e27e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.512427:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930227.514682:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930227.514696:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237e27e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.514709:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930227.514721:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237e27e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.514732:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237e27e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.514752:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237e27e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.514760:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095127978/0xce4472dd2237e27e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.514781:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930227.514783:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930227.514785:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788930227.515464:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.515475:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237e285 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.515487:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.515498:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.515505:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237e285 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.515518:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237e285 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.515528:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237e285 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.515536:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237e285 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.515559:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788930227.515724:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930227.515730:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237e285 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.515738:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2152400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.515741:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237e285 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.515749:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237e285 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.515761:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237e285 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.515767:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a2f8674/0xce4472dd2237e285 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.515781:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.515783:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.515785:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788930227.516341:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.516349:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237e28c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.516358:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.516361:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.516366:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237e28c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.516376:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237e28c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.516384:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237e28c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.516399:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237e28c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.516414:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930227.516677:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930227.516683:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237e28c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.516692:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ec2153a00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930227.516695:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237e28c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.516705:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237e28c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.516718:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237e28c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.516733:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053803936/0xce4472dd2237e28c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.516751:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930227.516753:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930227.516755:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788930227.517018:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.517024:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f500ad05/0xce4472dd2237e293 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.517033:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.517036:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.517041:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f500ad05/0xce4472dd2237e293 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.517051:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f500ad05/0xce4472dd2237e293 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.517059:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f500ad05/0xce4472dd2237e293 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.517067:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f500ad05/0xce4472dd2237e293 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.517945:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788930227.518498:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.518507:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1faf7c8/0xce4472dd2237e29a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.518527:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.518530:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.518536:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1faf7c8/0xce4472dd2237e29a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.518548:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1faf7c8/0xce4472dd2237e29a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.518556:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1faf7c8/0xce4472dd2237e29a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.519826:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1faf7c8/0xce4472dd2237e29a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.521006:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788930227.521018:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f500ad05/0xce4472dd2237e293 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.521044:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8c00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.521049:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f500ad05/0xce4472dd2237e293 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.521060:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f500ad05/0xce4472dd2237e293 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.521080:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f500ad05/0xce4472dd2237e293 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.521089:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f500ad05/0xce4472dd2237e293 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.521174:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930227.521181:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1faf7c8/0xce4472dd2237e29a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.521189:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930227.521193:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1faf7c8/0xce4472dd2237e29a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.521200:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1faf7c8/0xce4472dd2237e29a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.521212:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1faf7c8/0xce4472dd2237e29a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.521246:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930227.521250:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930227.521252:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930227.521409:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788930227.521418:0:20132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1faf7c8/0xce4472dd2237e29a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.521653:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788930227.522167:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.522175:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076fb7ebf/0xce4472dd2237e2a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.522188:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.522192:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.522198:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076fb7ebf/0xce4472dd2237e2a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.522361:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076fb7ebf/0xce4472dd2237e2a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.522373:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076fb7ebf/0xce4472dd2237e2a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.522382:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076fb7ebf/0xce4472dd2237e2a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.522404:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930227.522666:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930227.522673:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076fb7ebf/0xce4472dd2237e2a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.522687:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930227.522691:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076fb7ebf/0xce4472dd2237e2a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.522699:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076fb7ebf/0xce4472dd2237e2a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.522713:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076fb7ebf/0xce4472dd2237e2a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.522720:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076fb7ebf/0xce4472dd2237e2a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.522738:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930227.522740:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930227.522742:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788930227.523032:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.523039:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005632454f/0xce4472dd2237e2a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.523048:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.523051:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.523056:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005632454f/0xce4472dd2237e2a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.523065:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005632454f/0xce4472dd2237e2a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.523074:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005632454f/0xce4472dd2237e2a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.523093:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005632454f/0xce4472dd2237e2a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.523150:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788930227.523727:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.523733:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3f690db/0xce4472dd2237e2af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.523743:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.523746:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.523751:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3f690db/0xce4472dd2237e2af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.523760:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3f690db/0xce4472dd2237e2af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.523769:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3f690db/0xce4472dd2237e2af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.523776:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3f690db/0xce4472dd2237e2af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.524056:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788930227.524064:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005632454f/0xce4472dd2237e2a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.524073:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8a00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930227.524078:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005632454f/0xce4472dd2237e2a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.524087:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005632454f/0xce4472dd2237e2a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.524111:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005632454f/0xce4472dd2237e2a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.524120:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005632454f/0xce4472dd2237e2a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.524142:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930227.524146:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3f690db/0xce4472dd2237e2af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.524153:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930227.524157:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3f690db/0xce4472dd2237e2af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.524165:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3f690db/0xce4472dd2237e2af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.524175:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3f690db/0xce4472dd2237e2af lrc: 2/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930227.524183:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930227.524185:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930227.524187:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930227.524322:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788930227.524328:0:20132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3f690db/0xce4472dd2237e2af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788930227.524911:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.524919:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2c13f33/0xce4472dd2237e2b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.524928:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.524932:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.524936:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2c13f33/0xce4472dd2237e2b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.524947:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2c13f33/0xce4472dd2237e2b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.524956:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2c13f33/0xce4472dd2237e2b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.524964:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2c13f33/0xce4472dd2237e2b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.525027:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788930227.526258:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.526268:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237e2bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.526279:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.526283:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.526294:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237e2bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.526305:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237e2bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.526314:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237e2bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.526321:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237e2bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.526445:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788930227.526453:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2c13f33/0xce4472dd2237e2b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.526461:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.526465:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2c13f33/0xce4472dd2237e2b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.526474:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2c13f33/0xce4472dd2237e2b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.526490:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2c13f33/0xce4472dd2237e2b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.526504:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2c13f33/0xce4472dd2237e2b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.526521:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930227.526525:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237e2bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.526531:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.526534:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237e2bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.526542:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237e2bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.526553:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237e2bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.526560:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.526561:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.526574:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930227.527255:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930227.527437:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788930227.527445:0:20132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea08af1f/0xce4472dd2237e2bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788930227.528105:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.528113:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237e2c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.528126:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.528130:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.528135:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237e2c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.528148:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237e2c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.528170:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237e2c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.528177:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237e2c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.528204:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788930227.528321:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930227.528328:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237e2c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.528336:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.528346:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237e2c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.528355:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237e2c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.528370:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237e2c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.528377:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f77cf08/0xce4472dd2237e2c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.528392:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.528394:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.528396:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930227.528683:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788930227.528987:0:20132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788930227.528994:0:20132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011a77356/0xce4472dd2237e2cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.529003:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788930227.529006:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930227.529011:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011a77356/0xce4472dd2237e2cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.529021:0:20132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011a77356/0xce4472dd2237e2cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.529030:0:20132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011a77356/0xce4472dd2237e2cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.529038:0:20132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011a77356/0xce4472dd2237e2cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930227.529109:0:20132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788930227.529332:0:20132:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:34 00000100:00100000:0.0:1788930227.529443:0:20132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18984:x1875828770208000:12345-0@lo:5:osp-pre-0-0.0 Request processed in 102608us (106301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930227.529454:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788930227.529594:0:18984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18984:1875828770208000:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788930227.529620:0:18984:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x22:0x0] 00000100:00100000:2.0:1788930227.529673:0:18984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85136a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18984:1875828770208128:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788930227.529709:0:18984:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930227.529760:0:18984:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2eb5b07d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788930227.529873:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770208128 00000100:00100000:0.0:1788930227.529880:0:19647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770208128 00000100:00100000:0.0:1788930227.529928:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788930227.529937:0:19647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18984:x1875828770208128:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788930227.529974:0:19647:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00010000:00010000:1.0:1788930227.533545:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930227.533558:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011a77356/0xce4472dd2237e2cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.534200:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930227.534208:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011a77356/0xce4472dd2237e2cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.534319:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011a77356/0xce4472dd2237e2cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.534346:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011a77356/0xce4472dd2237e2cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.534362:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011a77356/0xce4472dd2237e2cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930227.534386:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.534389:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930227.534391:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930227.535215:0:19647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:18984:x1875828770208128:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5273us (5499us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788930227.535260:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788930227.537560:0:18984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85136a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18984:1875828770208128:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788930227.537601:0:18984:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00000001:00080000:3.0:1788930227.746969:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1788930227.747033:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788930228.064265:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930229.083713:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930230.107413:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930231.131997:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788930231.963343:0:20363:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788930231.963347:0:20363:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788930231.963450:0:20363:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d2e9824f800 00000020:01000004:2.0:1788930231.963465:0:20363:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788930231.963479:0:20363:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788930231.963492:0:20363:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d2e881e4d40) 00000020:00000080:2.0:1788930231.963521:0:20363:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788930232.000784:0:20363:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788930232.001159:0:20363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788930232.004054:0:20363:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788930232.004802:0:20363:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788930232.005201:0:20363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:3.0:1788930232.005924:0:20363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 573: rc = 0 00100000:10000000:3.0:1788930232.006111:0:20363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 573: rc = 0 00100000:10000000:3.0:1788930232.006218:0:20363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 573: rc = 0 00100000:10000000:3.0:1788930232.011770:0:20363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 769: rc = 0 00100000:10000000:3.0:1788930232.012048:0:20363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:3.0:1788930232.012331:0:20363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:3.0:1788930232.012593:0:20363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 769: rc = 0 00100000:10000000:3.0:1788930232.012847:0:20363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:3.0:1788930232.018122:0:20363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 769: rc = 0 00000020:00000080:2.0:1788930232.020842:0:20363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788930232.020862:0:20363:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788930232.020878:0:20363:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xce4472dd2237e2d9 00000020:01000004:2.0:1788930232.020889:0:20363:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788930232.020915:0:20363:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.140@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788930232.020920:0:20363:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788930232.020929:0:20363:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788930232.021291:0:20363:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788930232.021297:0:20363:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.140@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788930232.043649:0:20363:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.140@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788930232.043770:0:20363:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.140@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788930232.043776:0:20363:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788930232.043777:0:20363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788930232.043779:0:20363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788930232.043780:0:20363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788930232.043781:0:20363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788930232.043782:0:20363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788930232.043783:0:20363:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788930232.043785:0:20363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788930232.043786:0:20363:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788930232.043790:0:20363:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788930232.043792:0:20363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788930232.043793:0:20363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788930232.043794:0:20363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788930232.043795:0:20363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788930232.043796:0:20363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788930232.043804:0:20363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788930232.043805:0:20363:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788930232.043806:0:20363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788930232.043806:0:20363:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788930232.043846:0:20363:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788930232.043866:0:20363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770208256:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788930232.044015:0:20363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930232.044140:0:20363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d66f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788930232.044640:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770208256 00000100:00100000:2.0:1788930232.044650:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770208256 00000100:00100000:0.0:1788930232.044911:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788930232.044922:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:20363:x1875828770208256:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788930232.044967:0:18955:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788930232.044971:0:18955:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788930232.044976:0:18955:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788930232.055164:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:20363:x1875828770208256:12345-0@lo:253:mount.lustre.0 Request processed in 10233us (11211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930232.055181:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788930232.055332:0:20363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770208256:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788930232.055358:0:20363:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788930232.055362:0:20363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788930232.055364:0:20363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788930232.055365:0:20363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788930232.055366:0:20363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788930232.055367:0:20363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788930232.055368:0:20363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788930232.055370:0:20363:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788930232.055371:0:20363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788930232.055373:0:20363:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788930232.055399:0:20363:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d2e9824f800 from lustre-OST0001 10000000:01000000:0.0:1788930232.055430:0:20363:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788930232.055433:0:20363:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788930232.055441:0:20363:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d2eafc999c0 local copy 00010000:00010000:0.0:1788930232.055678:0:20363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8000/0xce4472dd2237e06a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e071 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930232.056058:0:20363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770208384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930232.056114:0:20363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930232.056164:0:20363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d66480 going to sleep for 11 seconds 00000100:00100000:1.0:1788930232.056303:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770208384 00000100:00100000:1.0:1788930232.056312:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770208384 00000100:00100000:1.0:1788930232.056446:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788930232.056457:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:20363:x1875828770208384:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788930232.056651:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:20363:x1875828770208384:12345-0@lo:501:mount.lustre.0 Request processed in 195us (535us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788930232.056660:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788930232.057280:0:20363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770208384:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788930232.057305:0:20363:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788930232.057651:0:20363:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788930232.057661:0:20363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8000/0xce4472dd2237e06a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e071 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930232.057673:0:20363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8000/0xce4472dd2237e06a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e071 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788930232.057907:0:20363:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d2e9824f800 10000000:01000000:3.0:1788930232.057913:0:20363:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788930232.057925:0:20363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788930232.057927:0:20363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788930232.057932:0:20363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788930232.057935:0:20363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788930232.058035:0:20363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237e2e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930232.058045:0:20363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237e2e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930232.058055:0:20363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237e2e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930232.058074:0:20363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770208512:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788930232.058120:0:20363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930232.058154:0:20363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98a9dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788930232.058429:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770208512 00000100:00100000:0.0:1788930232.058435:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770208512 00000100:00100000:0.0:1788930232.058482:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788930232.058491:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:20363:x1875828770208512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788930232.058579:0:18955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930232.058595:0:18955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237e2e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237e2e0 expref: -99 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930232.058621:0:18955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237e2e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237e2e0 expref: 17 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930232.058632:0:18955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebe0b8c00/0xce4472dd2237e2e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e2e0 expref: 17 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930232.058640:0:18955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8c00, rc 0) 00000100:00100000:0.0:1788930232.058688:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+17:20363:x1875828770208512:12345-0@lo:101:mount.lustre.0 Request processed in 198us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930232.058816:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788930232.058930:0:20363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770208512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788930232.059004:0:20363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237e2e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e2e7 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930232.059014:0:20363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237e2e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237e2e7 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788930232.061667:0:20363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1788930232.063570:0:20363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788930232.064211:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788930232.066801:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788930232.066864:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788930232.067047:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788930232.067095:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788930232.067133:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788930232.067186:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788930232.073675:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788930232.074069:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1788930232.074159:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1788930232.074168:0:20363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1788930232.074785:0:20363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770208640:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788930232.074873:0:20363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930232.074978:0:20363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e90a89a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788930232.075096:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770208640 00000100:00100000:0.0:1788930232.075104:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770208640 00000100:00100000:0.0:1788930232.075211:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788930232.075245:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+17:20363:x1875828770208640:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930232.075845:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+17:20363:x1875828770208640:12345-0@lo:501:mount.lustre.0 Request processed in 623us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930232.075860:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788930232.075982:0:20363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770208640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788930232.076042:0:20363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85134700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770208768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788930232.076088:0:20363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930232.076782:0:20363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e9810b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788930232.076936:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770208768 00000100:00100000:1.0:1788930232.076955:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770208768 00000100:00100000:1.0:1788930232.076997:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788930232.077006:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+17:20363:x1875828770208768:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788930232.077797:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+17:20363:x1875828770208768:12345-0@lo:503:mount.lustre.0 Request processed in 788us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930232.077806:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788930232.077946:0:20363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85134700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770208768:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788930232.079768:0:20363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788930232.079905:0:20363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85134700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770208896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788930232.080141:0:20363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930232.080263:0:20363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98660c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788930232.080368:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770208896 00000100:00100000:3.0:1788930232.080376:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770208896 00000100:00100000:1.0:1788930232.081021:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788930232.081037:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+17:20363:x1875828770208896:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788930232.081893:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+17:20363:x1875828770208896:12345-0@lo:502:mount.lustre.0 Request processed in 855us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930232.081906:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788930232.082194:0:20363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85134700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770208896:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788930232.084914:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788930232.085090:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788930232.085131:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788930232.085213:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788930232.085408:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788930232.085666:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788930232.085808:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788930232.085846:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788930232.085897:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1788930232.086030:0:20363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770209024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788930232.086120:0:20363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930232.086268:0:20363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98a9dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788930232.086792:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770209024 00000100:00100000:1.0:1788930232.086806:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770209024 00000100:00100000:1.0:1788930232.086921:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788930232.086933:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+17:20363:x1875828770209024:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788930232.087209:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+17:20363:x1875828770209024:12345-0@lo:502:mount.lustre.0 Request processed in 278us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930232.087217:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788930232.092009:0:20363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770209024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788930232.092185:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1788930232.092201:0:20363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788930232.093954:0:20364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788930232.093968:0:20364:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788930232.093974:0:20364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930232.093977:0:20364:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788930232.093986:0:20364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788930232.094004:0:20364:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d2e9162b380) 00000020:00000080:3.0:1788930232.094034:0:20364:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788930232.094042:0:20364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788930232.094135:0:20364:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2e9824f800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788930232.094143:0:20364:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788930232.094152:0:20364:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xce4472dd2237e2f5 00010000:00010000:3.0:1788930232.105641:0:20364:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788930232.109585:0:20364:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934593 00080000:10000000:3.0:1788930232.114067:0:20364:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1788930232.116603:0:20364:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788930232.116618:0:20364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788930232.116639:0:20364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930232.116642:0:20364:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788930232.116647:0:20364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788930232.116652:0:20364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930232.116653:0:20364:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788930232.116657:0:20364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788930232.116659:0:20364:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788930232.116661:0:20364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788930232.116664:0:20364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930232.116671:0:20364:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788930232.116674:0:20364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788930232.116677:0:20364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930232.116678:0:20364:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788930232.116682:0:20364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788930232.116927:0:20364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788930232.116932:0:20364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930232.116934:0:20364:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788930232.116937:0:20364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1788930232.118521:0:20363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788930232.118567:0:20363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788930232.118592:0:20363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237e2e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e2e7 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930232.118606:0:20363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebc596c00/0xce4472dd2237e2e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e2e7 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788930232.118615:0:20363:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2e9824f800 from 1 10000000:01000000:0.0:1788930232.118618:0:20363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788930232.118656:0:20363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9600/0xce4472dd2237e2fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930232.118665:0:20363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9600/0xce4472dd2237e2fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930232.118678:0:20363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9600/0xce4472dd2237e2fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930232.118781:0:20363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770209152:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788930232.118850:0:20363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930232.118898:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770209152 00000100:00100000:0.0:1788930232.118906:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770209152 00000100:00100000:0.0:1788930232.119448:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788930232.119466:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+17:20363:x1875828770209152:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788930232.119482:0:18954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930232.119507:0:18954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebe0b8200/0xce4472dd2237e303 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237e2fc expref: -99 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930232.119534:0:18954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebe0b8200/0xce4472dd2237e303 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237e2fc expref: 18 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930232.119545:0:18954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebe0b8200/0xce4472dd2237e303 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e2fc expref: 18 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930232.119554:0:18954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8200, rc 0) 00000100:00100000:0.0:1788930232.119598:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+18:20363:x1875828770209152:12345-0@lo:101:mount.lustre.0 Request processed in 134us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930232.119606:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788930232.119663:0:20363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2eb5b07480 going to sleep for 11 seconds 00000100:00100000:0.0:1788930232.119690:0:20363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770209152:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788930232.120103:0:20363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9600/0xce4472dd2237e2fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e303 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930232.120116:0:20363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9600/0xce4472dd2237e2fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237e303 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788930232.124156:0:20363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:0.0:1788930232.127105:0:20363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788930232.127971:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788930232.128023:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788930232.128062:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788930232.128093:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788930232.128130:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788930232.128171:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788930232.128200:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788930232.128254:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788930232.128329:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788930232.128346:0:20363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:0.0:1788930232.128457:0:20363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770209280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930232.128541:0:20363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930232.128588:0:20363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98250000 going to sleep for 11 seconds 00000100:00100000:2.0:1788930232.128808:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770209280 00000100:00100000:2.0:1788930232.128817:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770209280 00000100:00100000:2.0:1788930232.128865:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788930232.128874:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+18:20363:x1875828770209280:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788930232.129097:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+18:20363:x1875828770209280:12345-0@lo:501:mount.lustre.0 Request processed in 223us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930232.129104:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788930232.129209:0:20363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770209280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788930232.129277:0:20363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770209408:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788930232.129316:0:20363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930232.129347:0:20363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8773e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788930232.129458:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770209408 00000100:00100000:2.0:1788930232.129462:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770209408 00000100:00100000:2.0:1788930232.129488:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788930232.129506:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+18:20363:x1875828770209408:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788930232.129646:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+18:20363:x1875828770209408:12345-0@lo:503:mount.lustre.0 Request processed in 151us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930232.129652:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788930232.130201:0:20363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770209408:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788930232.130924:0:20363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788930232.131450:0:20363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770209536:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930232.131547:0:20363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930232.131592:0:20363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98250c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788930232.131724:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770209536 00000100:00100000:2.0:1788930232.131732:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770209536 00000100:00100000:2.0:1788930232.131782:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788930232.131791:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86746450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+18:20363:x1875828770209536:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788930232.131993:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86746450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+18:20363:x1875828770209536:12345-0@lo:502:mount.lustre.0 Request processed in 203us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930232.132000:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788930232.132284:0:20363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770209536:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788930232.132571:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788930232.132627:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788930232.132678:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788930232.132844:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788930232.132876:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788930232.132918:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788930232.133015:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788930232.133052:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:0.0:1788930232.133085:0:20363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770209664:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930232.133139:0:20363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930232.133169:0:20363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98250c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788930232.133262:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770209664 00000100:00100000:2.0:1788930232.133268:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770209664 00000100:00100000:2.0:1788930232.133310:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788930232.133318:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+18:20363:x1875828770209664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788930232.133577:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+18:20363:x1875828770209664:12345-0@lo:502:mount.lustre.0 Request processed in 260us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930232.133585:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788930232.134133:0:20363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770209664:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788930232.134268:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788930232.134280:0:20363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788930232.139518:0:20368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788930232.139532:0:20368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930232.139535:0:20368:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788930232.139542:0:20368:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2e9824f800 00000020:00000080:3.0:1788930232.139545:0:20368:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788930232.139553:0:20368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788930232.139556:0:20368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930232.139557:0:20368:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788930232.139560:0:20368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788930232.139562:0:20368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930232.139564:0:20368:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788930232.139567:0:20368:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d2e9824f800 00000020:00000080:3.0:1788930232.139581:0:20368:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788930232.139638:0:20368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788930232.139641:0:20368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930232.139642:0:20368:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788930232.139645:0:20368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788930232.139647:0:20368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930232.139648:0:20368:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788930232.139652:0:20368:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d2e9824f800 00000020:00000080:3.0:1788930232.139654:0:20368:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788930232.139687:0:20368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788930232.139689:0:20368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788930232.139691:0:20368:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788930232.140011:0:20368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:1.0:1788930232.143600:0:20363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788930232.143652:0:20363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788930232.143670:0:20363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9600/0xce4472dd2237e2fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e303 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.143683:0:20363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9600/0xce4472dd2237e2fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e303 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788930232.143774:0:20363:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788930232.143778:0:20363:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d2e9824f800 10000000:01000000:1.0:1788930232.143781:0:20363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d2e9824f800 10000000:01000000:1.0:1788930232.143787:0:20363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788930232.143794:0:20363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d2e9824f800 from 1 10000000:01000000:1.0:1788930232.143798:0:20363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788930232.143841:0:20363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d86a75e00/0xce4472dd2237e30a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.143849:0:20363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2d86a75e00/0xce4472dd2237e30a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.143861:0:20363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2d86a75e00/0xce4472dd2237e30a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930232.143887:0:20363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770209792:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788930232.144114:0:20363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930232.153111:0:20363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e868db180 going to sleep for 11 seconds 00000100:00100000:3.0:1788930232.153207:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770209792 00000100:00100000:3.0:1788930232.153218:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770209792 00000100:00100000:3.0:1788930232.153450:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788930232.153462:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+18:20363:x1875828770209792:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788930232.153479:0:18955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930232.153511:0:18955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc596400/0xce4472dd2237e311 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237e30a expref: -99 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930232.153540:0:18955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc596400/0xce4472dd2237e311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237e30a expref: 19 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930232.153551:0:18955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc596400/0xce4472dd2237e311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e30a expref: 19 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930232.153573:0:18955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596400, rc 0) 00000100:00100000:3.0:1788930232.153848:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:20363:x1875828770209792:12345-0@lo:101:mount.lustre.0 Request processed in 388us (9734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930232.153855:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:2.0:1788930232.158120:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930232.165469:0:20363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770209792:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788930232.165515:0:20363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2d86a75e00/0xce4472dd2237e30a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e311 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.165529:0:20363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2d86a75e00/0xce4472dd2237e30a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237e311 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788930232.169123:0:20363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:0.0:1788930232.174675:0:20363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788930232.175786:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788930232.175852:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788930232.175885:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788930232.175980:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788930232.176020:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788930232.176068:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788930232.176105:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788930232.176141:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788930232.176191:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788930232.176414:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788930232.176451:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788930232.176504:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788930232.176542:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788930232.176574:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788930232.176643:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788930232.176684:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788930232.176718:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788930232.176773:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788930232.176811:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788930232.176872:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788930232.176927:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788930232.176963:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788930232.176999:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788930232.177048:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788930232.177085:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:0.0:1788930232.177117:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:0.0:1788930232.177164:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:0.0:1788930232.177197:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:0.0:1788930232.177259:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:0.0:1788930232.177310:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:0.0:1788930232.177366:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:0.0:1788930232.177402:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:0.0:1788930232.177434:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:0.0:1788930232.177483:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:0.0:1788930232.177542:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:0.0:1788930232.177613:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:0.0:1788930232.177662:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:0.0:1788930232.177700:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:0.0:1788930232.177747:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:0.0:1788930232.177785:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:0.0:1788930232.177881:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:0.0:1788930232.177889:0:20363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:0.0:1788930232.178015:0:20363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770209920:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930232.185716:0:20363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930232.185767:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770209920 00000100:00100000:0.0:1788930232.185777:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770209920 00000100:00100000:0.0:1788930232.185841:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788930232.185852:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:20363:x1875828770209920:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930232.186172:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:20363:x1875828770209920:12345-0@lo:501:mount.lustre.0 Request processed in 321us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930232.186181:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788930232.186308:0:20363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98e50c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788930232.186351:0:20363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770209920:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788930232.186412:0:20363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770210048:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788930232.186460:0:20363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930232.186485:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770210048 00000100:00100000:0.0:1788930232.186489:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770210048 00000100:00100000:0.0:1788930232.186525:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788930232.186533:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:20363:x1875828770210048:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788930232.186684:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:20363:x1875828770210048:12345-0@lo:503:mount.lustre.0 Request processed in 151us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930232.186691:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788930232.186723:0:20363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98e50c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788930232.186741:0:20363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770210048:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788930232.187377:0:20363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788930232.187451:0:20363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770210176:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930232.187505:0:20363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930232.187538:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770210176 00000100:00100000:0.0:1788930232.187544:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770210176 00000100:00100000:0.0:1788930232.187571:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788930232.187579:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:20363:x1875828770210176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930232.187757:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:20363:x1875828770210176:12345-0@lo:502:mount.lustre.0 Request processed in 179us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930232.187765:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788930232.187800:0:20363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98e50c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788930232.187815:0:20363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770210176:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788930232.188026:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788930232.188076:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788930232.188114:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788930232.188160:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788930232.188199:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788930232.188279:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788930232.188319:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788930232.188370:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788930232.188422:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788930232.188459:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788930232.190171:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788930232.191085:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788930232.191160:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788930232.191200:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788930232.191466:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788930232.191545:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788930232.191586:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788930232.191639:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788930232.191680:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788930232.191720:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788930232.191774:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788930232.191817:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788930232.191854:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788930232.191932:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788930232.192178:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:0.0:1788930232.192208:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:0.0:1788930232.192454:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:0.0:1788930232.192578:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:0.0:1788930232.192626:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:0.0:1788930232.192685:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:0.0:1788930232.192725:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:0.0:1788930232.192764:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:0.0:1788930232.192803:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:0.0:1788930232.192858:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:0.0:1788930232.192898:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:0.0:1788930232.195092:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:0.0:1788930232.195476:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:0.0:1788930232.195545:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:0.0:1788930232.195629:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:0.0:1788930232.195688:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:0.0:1788930232.195745:0:20363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770210304:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788930232.195838:0:20363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930232.195890:0:20363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e98e50c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788930232.196197:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770210304 00000100:00100000:1.0:1788930232.196206:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770210304 00000100:00100000:1.0:1788930232.196287:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788930232.196305:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:20363:x1875828770210304:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788930232.196600:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:20363:x1875828770210304:12345-0@lo:502:mount.lustre.0 Request processed in 296us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930232.196609:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788930232.196895:0:20363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770210304:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788930232.197073:0:20363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:0.0:1788930232.197086:0:20363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788930232.205805:0:20373:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788930232.205824:0:20373:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d2e87cab380) 00000020:00000080:0.0:1788930232.205850:0:20373:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788930232.205928:0:20373:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d2e9824f800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788930232.205932:0:20373:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d2e9824f800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788930232.206105:0:20373:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d2e9824f800 3 00010000:00080000:1.0:1788930232.206860:0:20373:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d2eb5448800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.140@tcp at head 00010000:00010000:1.0:1788930232.209057:0:20373:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788930232.209321:0:20373:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788930232.213810:0:20373:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788930232.213837:0:20373:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xce4472dd2237e31f 00000100:00080000:1.0:1788930232.213851:0:20373:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788930232.213864:0:20373:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d2eb5448800 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1788930232.213902:0:20373:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2e9837c380 x1875828770210432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788930232.213932:0:20373:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788930232.214022:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788930232.214026:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788930232.214028:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d2e986b1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788930232.214032:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 612 00000100:00080000:1.0:1788930232.214036:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788930232.214041:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2e986b1000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:1.0:1788930232.214054:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2e9837c000 x1875828770210688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788930232.214209:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875828770210432:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788930232.214305:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930232.214585:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770210688:0@lo:8:kworker.0 00000100:00100000:2.0:1788930232.214615:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930232.214743:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770210688 00000100:00100000:2.0:1788930232.214751:0:19646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770210688 00000100:00100000:2.0:1788930232.214782:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788930232.214789:0:19646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875828770210688:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788930232.214855:0:19646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875828770210688:12345-0@lo:8:kworker.0 Request processed in 64us (238us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788930232.214862:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788930232.214899:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788930232.214907:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e986b1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788930232.214922:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788930232.214926:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770210688:0@lo:8:kworker.0 00000100:00100000:1.0:1788930232.215028:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770210432 00000100:00100000:1.0:1788930232.215033:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770210432 00000100:00100000:1.0:1788930232.215057:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788930232.215063:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875828770210432:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788930232.215088:0:18963:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 617 last 0 00000020:00000080:1.0:1788930232.215131:0:18963:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xce4472dd2237e326 00000004:00100000:1.0:1788930232.215147:0:18963:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788930232.215179:0:18963:0:(import.c:65:import_set_state_nolock()) ffff8d2d849f8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788930232.215248:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875828770210432:12345-0@lo:38:llog_process_th.0 Request processed in 184us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930232.215256:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788930232.215426:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770210816:0@lo:400:kworker.0 00000100:00100000:3.0:1788930232.215462:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930232.215487:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00080000:2.0:1788930232.215599:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e9837c380 x1875828770210432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788930242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930232.215609:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788930232.215614:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788930232.215622:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788930232.215626:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788930232.215629:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2eb5448800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788930232.215635:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875828770210432:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788930232.215687:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770210560:0@lo:400:kworker.0 00000100:00100000:3.0:1788930232.215717:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930232.215749:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788930232.215757:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875828770210944:0@lo:400:kworker.0 00000100:00100000:3.0:1788930232.215783:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930232.215811:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770210816 00000100:00100000:3.0:1788930232.215816:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770210816 00000100:00100000:3.0:1788930232.215842:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770210944 00000100:00100000:3.0:1788930232.215845:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770210944 00000100:00100000:3.0:1788930232.215870:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788930232.215877:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770210816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930232.215916:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875828770210816:12345-0@lo:400:kworker.0 Request processed in 39us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930232.215922:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788930232.215936:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788930232.216070:0:20132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770210560 00000100:00100000:0.0:1788930232.216075:0:20132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770210560 00000100:00100000:0.0:1788930232.216109:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788930232.216117:0:20132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770210560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930232.216149:0:20132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770210560:12345-0@lo:400:kworker.0 Request processed in 34us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930232.216155:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788930232.216835:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875828770210944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930232.216894:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875828770210944:12345-0@lo:400:kworker.0 Request processed in 64us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930232.216901:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788930232.216923:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788930232.216928:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788930232.217089:0:20373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000100:00100000:3.0:1788930232.217264:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788930232.217280:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770210560:0@lo:400:kworker.0 00000020:01000000:1.0:1788930232.217345:0:20363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788930232.217371:0:20363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788930232.217387:0:20363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d86a75e00/0xce4472dd2237e30a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e311 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.217398:0:20363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2d86a75e00/0xce4472dd2237e30a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e311 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788930232.217461:0:20363:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788930232.217463:0:20363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788930232.217465:0:20363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788930232.217466:0:20363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788930232.217467:0:20363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788930232.217468:0:20363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788930232.217470:0:20363:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788930232.217472:0:20363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788930232.217473:0:20363:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788930232.217477:0:20363:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788930232.217479:0:20363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788930232.217481:0:20363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788930232.217482:0:20363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788930232.217483:0:20363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788930232.217483:0:20363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788930232.217485:0:20363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788930232.217486:0:20363:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788930232.217487:0:20363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788930232.217510:0:20363:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788930232.217534:0:20363:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788930232.217552:0:20363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770211072:0@lo:253:mount.lustre.0 00010000:00080000:2.0:1788930232.217681:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e9837fb80 x1875828770210944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788930232.217692:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875828770210944:0@lo:400:kworker.0 00010000:00080000:3.0:1788930232.217761:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e9837f100 x1875828770210816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788930232.217777:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875828770210816:0@lo:400:kworker.0 00000100:00100000:1.0:1788930232.224317:0:20363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930232.224362:0:20363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e868db840 going to sleep for 11 seconds 00000100:00100000:3.0:1788930232.224472:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770211072 00000100:00100000:3.0:1788930232.224482:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770211072 00000100:00100000:3.0:1788930232.224555:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788930232.224566:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:20363:x1875828770211072:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788930232.224629:0:18954:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788930232.224647:0:18954:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788930232.258684:0:18954:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788930232.258705:0:18954:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788930232.258790:0:18977:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788930232.258796:0:18977:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788930232.258821:0:18977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e32d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.258841:0:18977:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ebe0b9000/0xce4472dd2237e1eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e1e4 expref: 19 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.258851:0:18977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e32d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.258891:0:18977:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ebe0b9000/0xce4472dd2237e1eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237e1e4 expref: 19 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.258911:0:18977:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2ebe0b9000/0xce4472dd2237e1eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237e1e4 expref: 19 pid: 18954 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930232.258925:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18977:1875828770211200:0@lo:104: 00000100:00100000:1.0:1788930232.258995:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930232.259036:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e868db6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788930232.259148:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770211200 00000100:00100000:3.0:1788930232.259157:0:18944:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770211200 00000100:00100000:3.0:1788930232.259281:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788930232.259293:0:18944:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c52ce1e4-e465-4485-9875-0a24e445f9ec+3:18977:x1875828770211200:12345-0@lo:104: 00010000:00010000:3.0:1788930232.259308:0:18944:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9c00/0xce4472dd2237e1e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237e1eb expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930232.259363:0:18944:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788930232.259369:0:18944:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c52ce1e4-e465-4485-9875-0a24e445f9ec+3:18977:x1875828770211200:12345-0@lo:104: Request processed in 79us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930232.259376:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788930232.259435:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18977:1875828770211200:0@lo:104: 00010000:00010000:1.0:1788930232.259454:0:18977:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e32d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930232.259504:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788930232.259511:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9c00/0xce4472dd2237e1e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237e1eb expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930232.259518:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9c00 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:3.0:1788930232.259523:0:18950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9c00/0xce4472dd2237e1e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237e1eb expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930232.259552:0:18950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9c00/0xce4472dd2237e1e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237e1eb expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788930232.259560:0:18950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9c00/0xce4472dd2237e1e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237e1eb expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788930232.259567:0:18950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788930232.259684:0:18950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9c00/0xce4472dd2237e1e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e1eb expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930232.259692:0:18950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788930232.259742:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c52ce1e4-e465-4485-9875-0a24e445f9ec:3309:1875828770211328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788930232.259782:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788930232.259823:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9c00/0xce4472dd2237e1e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e1eb expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930232.259832:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9c00/0xce4472dd2237e1e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e1eb expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930232.259850:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930232.259852:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930232.259854:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930232.259893:0:18948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770211328 00000100:00100000:1.0:1788930232.259898:0:18948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770211328 00010000:00010000:1.0:1788930232.259917:0:18948:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ebe0b9000/0xce4472dd2237e1eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237e1e4 expref: 20 pid: 18954 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930232.260274:0:18948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788930232.260283:0:18948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c52ce1e4-e465-4485-9875-0a24e445f9ec+20:3309:x1875828770211328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788930232.260296:0:18948:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930232.260302:0:18948:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ebe0b9000/0xce4472dd2237e1eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237e1e4 expref: 20 pid: 18954 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.260312:0:18948:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ebe0b9000/0xce4472dd2237e1eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237e1e4 expref: 20 pid: 18954 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.260326:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebe0b9000/0xce4472dd2237e1eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237e1e4 expref: 20 pid: 18954 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.260339:0:18948:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e32d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.260347:0:18948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e32d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788930232.260361:0:18948:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002407911s 00010000:00010000:1.0:1788930232.260365:0:18948:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e32d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.260373:0:18948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e32d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.260391:0:18948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e32d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.260398:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e32d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.260404:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a75800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930232.260408:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e32d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.260415:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e32d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930232.260837:0:18977:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e32d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930232.260847:0:18977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e32d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.261137:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e32d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.261242:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d86a75800/0xce4472dd2237e32d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930232.261261:0:18948:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930232.261321:0:18948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:3309:x1875828770211328:12345-0@lo:103:ldlm_bl.0 Request processed in 1039us (1537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930232.261330:0:18948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788930232.261537:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c52ce1e4-e465-4485-9875-0a24e445f9ec:3309:1875828770211328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788930232.265198:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+18:20363:x1875828770211072:12345-0@lo:253:mount.lustre.0 Request processed in 40623us (40879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930232.265215:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788930232.265530:0:20363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c52ce1e4-e465-4485-9875-0a24e445f9ec:20363:1875828770211072:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788930232.265546:0:20363:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788930232.265550:0:20363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788930232.265551:0:20363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788930232.265553:0:20363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788930232.265554:0:20363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788930232.265556:0:20363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788930232.265557:0:20363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788930232.265558:0:20363:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788930232.265576:0:20363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788930232.265578:0:20363:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788930232.265594:0:20363:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788930232.266162:0:20363:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788930232.266914:0:20363:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788930232.267164:0:20363:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788930232.267688:0:20363:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788930232.267856:0:20363:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788930232.268115:0:20363:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788930232.269516:0:20363:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788930232.334796:0:20363:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788930232.334805:0:20363:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788930232.334841:0:20363:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788930232.334918:0:20363:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.140@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788930232.335030:0:20363:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788930232.335144:0:20363:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:2.0:1788930232.800514:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770211456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788930232.800594:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930232.800748:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770211456 00000100:00100000:3.0:1788930232.800758:0:19648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770211456 00000100:00100000:3.0:1788930232.800815:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788930232.800827:0:19648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770211456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788930232.800862:0:19648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788930232.800939:0:19648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770211456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930232.800948:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788930232.801069:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770211456:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788930233.179490:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788930233.948318:0:18958:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788930233.948328:0:18958:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d2e863d1000 from 11 10000000:01000000:2.0:1788930233.948334:0:18958:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788930233.948413:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784800/0xce4472dd2237e334 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930233.948426:0:18958:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2e99784800/0xce4472dd2237e334 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930233.948437:0:18958:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2e99784800/0xce4472dd2237e334 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930233.948473:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85135880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770211584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788930233.948593:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930233.948647:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86352cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788930233.948844:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770211584 00000100:00100000:0.0:1788930233.948855:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770211584 00000100:00100000:0.0:1788930233.948925:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788930233.948936:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+18:18958:x1875828770211584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788930233.948952:0:18956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930233.948978:0:18956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebe0b9800/0xce4472dd2237e33b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237e334 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930233.949004:0:18956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebe0b9800/0xce4472dd2237e33b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237e334 expref: 19 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930233.949014:0:18956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebe0b9800/0xce4472dd2237e33b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e334 expref: 19 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930233.949023:0:18956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9800, rc 0) 00000100:00100000:0.0:1788930233.949072:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:18958:x1875828770211584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930233.949079:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788930233.949268:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85135880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770211584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788930233.949289:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2e99784800/0xce4472dd2237e334 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e33b expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930233.949298:0:18958:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2e99784800/0xce4472dd2237e334 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237e33b expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930233.949369:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770211712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788930233.949417:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930233.949440:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8773e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788930233.949591:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770211712 00000100:00100000:0.0:1788930233.949596:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770211712 00000100:00100000:0.0:1788930233.949629:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788930233.949636:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:18958:x1875828770211712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788930233.949650:0:18954:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788930233.949673:0:18954:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788930233.949676:0:18954:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788930233.949757:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:18958:x1875828770211712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930233.949767:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788930233.952583:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770211712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788930233.952680:0:18958:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788930233.952691:0:18958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2e99784800/0xce4472dd2237e334 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e33b expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930233.952703:0:18958:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2e99784800/0xce4472dd2237e334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e33b expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930234.203508:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930235.227371:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788930235.739877:0:18994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788930236.251855:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.282765:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788930237.407072:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788930237.407079:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788930237.407082:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d2e986b1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788930237.407100:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d2e986b1000 using connection 192.168.204.140@tcp/0@lo 00000100:00100000:0.0:1788930237.407119:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d2ebbffa680 x1875828770212096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788930237.407343:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c52ce1e4-e465-4485-9875-0a24e445f9ec:3311:1875828770211840:0@lo:400:kworker.0 00000100:00100000:0.0:1788930237.407427:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930237.407470:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875828770212480:0@lo:400:kworker.0 00000100:00100000:0.0:1788930237.407498:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930237.407518:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788930237.407523:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770212352:0@lo:400:kworker.0 00000100:00100000:0.0:1788930237.407540:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930237.407562:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770211968:0@lo:400:kworker.0 00000100:00100000:0.0:1788930237.407593:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930237.407609:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788930237.407614:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770212224:0@lo:400:kworker.0 00000100:00100000:0.0:1788930237.407631:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930237.407652:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770212096:0@lo:8:kworker.0 00000100:00100000:0.0:1788930237.407672:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930237.407755:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770211840 00000100:00100000:0.0:1788930237.407763:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770211840 00000100:00100000:0.0:1788930237.407802:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788930237.407810:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:3311:x1875828770211840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930237.409765:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:3311:x1875828770211840:12345-0@lo:400:kworker.0 Request processed in 1946us (2329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930237.409779:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788930237.409830:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770212480 00000100:00100000:0.0:1788930237.409965:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770212480 00000100:00100000:0.0:1788930237.410014:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770212352 00000100:00100000:0.0:1788930237.410018:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770212352 00000100:00100000:0.0:1788930237.410031:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770212224 00000100:00100000:0.0:1788930237.410033:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770212224 00000100:00100000:0.0:1788930237.410047:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788930237.410054:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875828770212480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930237.410106:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875828770212480:12345-0@lo:400:kworker.0 Request processed in 52us (2607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930237.410113:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788930237.410124:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788930237.410129:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770212352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930237.410154:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770212352:12345-0@lo:400:kworker.0 Request processed in 26us (2614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930237.410159:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788930237.410169:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788930237.410174:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770212224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930237.410205:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770212224:12345-0@lo:400:kworker.0 Request processed in 30us (2573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930237.410220:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788930237.410260:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770211968 00000100:00100000:0.0:1788930237.410264:0:19646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770211968 00000100:00100000:0.0:1788930237.410288:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770212096 00000100:00100000:0.0:1788930237.410291:0:19646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770212096 00000100:00100000:0.0:1788930237.410307:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788930237.410313:0:19646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770211968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930237.410347:0:19646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770211968:12345-0@lo:400:kworker.0 Request processed in 34us (2753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930237.410353:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788930237.410364:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788930237.410368:0:19646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875828770212096:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788930237.410404:0:19646:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 622 last 0 00000020:00000080:0.0:1788930237.413813:0:19646:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xce4472dd2237e342 00002000:00100000:0.0:1788930237.413853:0:19646:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d2e8b474000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788930237.413859:0:19646:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788930237.413862:0:19646:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788930237.414276:0:19646:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788930237.414313:0:19646:0:(import.c:65:import_set_state_nolock()) ffff8d2e8b472000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788930237.414431:0:19646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875828770212096:12345-0@lo:8:kworker.0 Request processed in 4059us (6756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930237.414441:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788930237.417569:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebbff8000 x1875828770212352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930237.417714:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770212352:0@lo:400:kworker.0 00000100:00100000:0.0:1788930237.417749:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c52ce1e4-e465-4485-9875-0a24e445f9ec:3311:1875828770211840:0@lo:400:kworker.0 00010000:00080000:0.0:1788930237.417762:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebbffaa00 x1875828770212480/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930237.417770:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875828770212480:0@lo:400:kworker.0 00000100:00080000:0.0:1788930237.417834:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788930237.417901:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788930237.417930:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebbffad80 x1875828770212224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930237.417939:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770212224:0@lo:400:kworker.0 00000100:00100000:0.0:1788930237.417951:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770211968:0@lo:400:kworker.0 00010000:00080000:0.0:1788930237.417991:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebbffa680 x1875828770212096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788930262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788930237.418004:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788930237.418012:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788930237.418018:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788930237.418022:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8d2e986b1000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788930237.418035:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788930237.418041:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875828770212096:0@lo:8:kworker.0 00000004:00080000:0.0:1788930237.419355:0:18986:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788930237.419382:0:18986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbff8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18986:1875828770212736:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788930237.419454:0:18986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930237.419484:0:18986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d22600 going to sleep for 11 seconds 00000004:00080000:0.0:1788930237.419500:0:18985:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788930237.420186:0:18985:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 622575960944ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788930237.420207:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788930237.422510:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770212736 00000100:00100000:1.0:1788930237.422523:0:19646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770212736 00000100:00100000:1.0:1788930237.422587:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788930237.422598:0:19646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:18986:x1875828770212736:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788930237.423549:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2ebbffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770212608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788930237.423628:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930237.424167:0:19649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770212608 00000100:00100000:3.0:1788930237.424175:0:19649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770212608 00000100:00100000:3.0:1788930237.424242:0:19649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788930237.424260:0:19649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875828770212608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788930237.424304:0:19649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788930237.426827:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788930237.430183:0:19649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875828770212608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5914us (6543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930237.430199:0:19649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788930237.431420:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2ebbffa680 x1875828770212608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788930253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788930237.431451:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770212608:0@lo:13:osp-pre-1-0.0 00002000:00080000:0.0:1788930237.433969:0:19646:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788930237.433983:0:19646:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:0.0:1788930237.433988:0:19646:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:65) 00002000:00010000:2.0:1788930237.477080:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.477094:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000096929de/0xce4472dd2237e349 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.477113:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.477117:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.477125:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000096929de/0xce4472dd2237e349 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.477144:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000096929de/0xce4472dd2237e349 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.477155:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000096929de/0xce4472dd2237e349 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.477179:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000096929de/0xce4472dd2237e349 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.477196:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788930237.478850:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930237.478864:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000096929de/0xce4472dd2237e349 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930237.478878:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785a00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930237.478883:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000096929de/0xce4472dd2237e349 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930237.478894:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000096929de/0xce4472dd2237e349 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930237.478920:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000096929de/0xce4472dd2237e349 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930237.478929:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000096929de/0xce4472dd2237e349 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930237.478972:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930237.478974:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930237.478976:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.480025:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.480042:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc01b7d0/0xce4472dd2237e350 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.480059:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.480063:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.480069:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc01b7d0/0xce4472dd2237e350 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.480083:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc01b7d0/0xce4472dd2237e350 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.480093:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc01b7d0/0xce4472dd2237e350 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.480099:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc01b7d0/0xce4472dd2237e350 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.480119:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930237.480133:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930237.480138:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc01b7d0/0xce4472dd2237e350 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.480160:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99784000 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930237.480165:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc01b7d0/0xce4472dd2237e350 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.480174:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc01b7d0/0xce4472dd2237e350 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.480190:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc01b7d0/0xce4472dd2237e350 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.480197:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc01b7d0/0xce4472dd2237e350 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.480214:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.480216:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.480217:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.484515:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.484530:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e357 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.484549:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.484554:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.484561:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e357 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.484585:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e357 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.484613:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e357 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.484621:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e357 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.484641:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930237.484654:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930237.484660:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e357 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.484668:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930237.484672:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e357 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.484681:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e357 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.484697:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e357 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.484704:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e357 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.484723:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.484800:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.484802:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.489680:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.489695:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000333f6c55/0xce4472dd2237e35e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.489713:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.489719:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.490412:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000333f6c55/0xce4472dd2237e35e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.490445:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000333f6c55/0xce4472dd2237e35e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.490459:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000333f6c55/0xce4472dd2237e35e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.490468:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000333f6c55/0xce4472dd2237e35e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.490496:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788930237.490821:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788930237.490836:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000333f6c55/0xce4472dd2237e35e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.490861:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:3.0:1788930237.490866:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000333f6c55/0xce4472dd2237e35e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.490875:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000333f6c55/0xce4472dd2237e35e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.490896:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000333f6c55/0xce4472dd2237e35e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.490903:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000333f6c55/0xce4472dd2237e35e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.496553:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930237.496562:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930237.496565:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.500722:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.500733:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237e365 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.500750:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.500755:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.500762:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237e365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.500783:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237e365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.500794:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237e365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.500802:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237e365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.500818:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930237.500830:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930237.500836:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237e365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.500842:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930237.500846:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237e365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.500854:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237e365 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.500869:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237e365 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.500877:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237e365 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.500898:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.500900:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.500901:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.501645:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.501652:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e715f4d0/0xce4472dd2237e36c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.501662:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.501666:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.501672:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e715f4d0/0xce4472dd2237e36c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.501682:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e715f4d0/0xce4472dd2237e36c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.501692:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e715f4d0/0xce4472dd2237e36c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.501700:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e715f4d0/0xce4472dd2237e36c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.501718:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930237.501728:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930237.501732:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e715f4d0/0xce4472dd2237e36c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.501750:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340c00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930237.501755:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e715f4d0/0xce4472dd2237e36c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.501764:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e715f4d0/0xce4472dd2237e36c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.501776:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e715f4d0/0xce4472dd2237e36c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.501782:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e715f4d0/0xce4472dd2237e36c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.501798:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.501800:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.501802:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.502724:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.502734:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004085e654/0xce4472dd2237e373 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.502744:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.502748:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.502752:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004085e654/0xce4472dd2237e373 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.502764:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004085e654/0xce4472dd2237e373 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.502782:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004085e654/0xce4472dd2237e373 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.502790:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004085e654/0xce4472dd2237e373 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.502807:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930237.502818:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930237.502824:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004085e654/0xce4472dd2237e373 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.502832:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340e00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930237.502836:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004085e654/0xce4472dd2237e373 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.502844:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004085e654/0xce4472dd2237e373 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.502858:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004085e654/0xce4472dd2237e373 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.502866:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004085e654/0xce4472dd2237e373 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.502884:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.502892:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.502895:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.504145:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.504158:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237e37a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.504174:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.504178:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.504183:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237e37a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.504211:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237e37a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.504237:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237e37a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.504253:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237e37a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.504283:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930237.504301:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930237.504306:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237e37a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.504313:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340a00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930237.504317:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237e37a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.504338:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237e37a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.504354:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237e37a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.504362:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237e37a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.504382:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.504384:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.504385:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.505057:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.505065:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8d2d9ee/0xce4472dd2237e381 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.505075:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.505079:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.505083:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d2d9ee/0xce4472dd2237e381 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.505094:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8d2d9ee/0xce4472dd2237e381 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.505103:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8d2d9ee/0xce4472dd2237e381 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.505118:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d2d9ee/0xce4472dd2237e381 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.505144:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788930237.505242:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930237.505251:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8d2d9ee/0xce4472dd2237e381 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930237.505263:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341a00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930237.505267:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8d2d9ee/0xce4472dd2237e381 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930237.505276:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8d2d9ee/0xce4472dd2237e381 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930237.505293:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8d2d9ee/0xce4472dd2237e381 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930237.505301:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8d2d9ee/0xce4472dd2237e381 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930237.505319:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930237.505321:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930237.505322:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.505861:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.505869:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007525662d/0xce4472dd2237e388 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.505878:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.505881:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.505885:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007525662d/0xce4472dd2237e388 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.505895:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007525662d/0xce4472dd2237e388 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.505902:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007525662d/0xce4472dd2237e388 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.505909:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007525662d/0xce4472dd2237e388 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.505935:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788930237.505985:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930237.505999:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007525662d/0xce4472dd2237e388 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930237.506008:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930237.506012:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007525662d/0xce4472dd2237e388 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930237.506022:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007525662d/0xce4472dd2237e388 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930237.506035:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007525662d/0xce4472dd2237e388 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930237.506044:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007525662d/0xce4472dd2237e388 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930237.506064:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930237.506067:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930237.506068:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.506874:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.506883:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004102f071/0xce4472dd2237e38f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.506901:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.506904:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.506909:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004102f071/0xce4472dd2237e38f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.506920:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004102f071/0xce4472dd2237e38f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.506929:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004102f071/0xce4472dd2237e38f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.506936:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004102f071/0xce4472dd2237e38f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.506951:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788930237.507438:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930237.507446:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004102f071/0xce4472dd2237e38f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930237.507455:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930237.507459:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004102f071/0xce4472dd2237e38f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930237.507479:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004102f071/0xce4472dd2237e38f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930237.507493:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004102f071/0xce4472dd2237e38f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930237.507501:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004102f071/0xce4472dd2237e38f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930237.507519:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930237.507521:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930237.507523:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.514104:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.516840:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e396 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.516869:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.516875:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.516883:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.516900:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.516927:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.516935:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e396 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.516961:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930237.516981:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930237.516988:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e396 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.516996:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930237.517001:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e396 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.517010:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e396 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.517027:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e396 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.517034:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e396 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.517059:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.517067:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.517069:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788930237.524121:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788930237.524833:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.524845:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2b2c845/0xce4472dd2237e39d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.524865:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.524870:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.524877:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2b2c845/0xce4472dd2237e39d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.524892:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2b2c845/0xce4472dd2237e39d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.524904:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2b2c845/0xce4472dd2237e39d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.524912:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2b2c845/0xce4472dd2237e39d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.524936:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788930237.526342:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.526354:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb322848/0xce4472dd2237e3a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.526368:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.526372:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.526385:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb322848/0xce4472dd2237e3a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.526410:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb322848/0xce4472dd2237e3a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.526421:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb322848/0xce4472dd2237e3a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.526429:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb322848/0xce4472dd2237e3a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.526450:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788930237.526466:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788930237.526473:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2b2c845/0xce4472dd2237e39d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.526481:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340000 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930237.526486:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2b2c845/0xce4472dd2237e39d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.526495:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2b2c845/0xce4472dd2237e39d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.526513:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2b2c845/0xce4472dd2237e39d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.526534:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2b2c845/0xce4472dd2237e39d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.526576:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930237.526580:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb322848/0xce4472dd2237e3a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.526588:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930237.526591:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb322848/0xce4472dd2237e3a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.526599:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb322848/0xce4472dd2237e3a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.526611:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb322848/0xce4472dd2237e3a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.526618:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb322848/0xce4472dd2237e3a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.526631:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.526633:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.526635:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.527158:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.527165:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c81fb88e/0xce4472dd2237e3ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.527180:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.527184:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.527187:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c81fb88e/0xce4472dd2237e3ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.527197:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c81fb88e/0xce4472dd2237e3ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.527205:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c81fb88e/0xce4472dd2237e3ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.527211:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c81fb88e/0xce4472dd2237e3ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.527246:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788930237.527271:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788930237.527279:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c81fb88e/0xce4472dd2237e3ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.527289:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341000 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:3.0:1788930237.527294:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c81fb88e/0xce4472dd2237e3ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.527316:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c81fb88e/0xce4472dd2237e3ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.527331:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c81fb88e/0xce4472dd2237e3ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.527339:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c81fb88e/0xce4472dd2237e3ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.527359:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930237.527364:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930237.527366:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.527650:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.527656:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237e3b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.527664:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.527668:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.527672:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237e3b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.527681:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237e3b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.527700:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237e3b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.527707:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237e3b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.527728:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788930237.528047:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788930237.528053:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237e3b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.528062:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:3.0:1788930237.528065:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237e3b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.528073:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237e3b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.528086:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237e3b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.528107:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237e3b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.528125:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930237.528126:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930237.528128:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930237.528341:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.535049:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.535063:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a684c3a/0xce4472dd2237e3b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.535081:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.535086:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.535093:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a684c3a/0xce4472dd2237e3b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.535108:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a684c3a/0xce4472dd2237e3b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.535457:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a684c3a/0xce4472dd2237e3b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.535467:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a684c3a/0xce4472dd2237e3b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.535509:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930237.535530:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930237.535535:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a684c3a/0xce4472dd2237e3b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.535543:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341c00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930237.535548:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a684c3a/0xce4472dd2237e3b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.535628:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a684c3a/0xce4472dd2237e3b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.535648:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a684c3a/0xce4472dd2237e3b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.535655:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a684c3a/0xce4472dd2237e3b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.535675:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.535676:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.535678:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.536153:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.536160:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a191c89c/0xce4472dd2237e3c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.536170:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.536179:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.536184:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a191c89c/0xce4472dd2237e3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.536194:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a191c89c/0xce4472dd2237e3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.536202:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a191c89c/0xce4472dd2237e3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.536209:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a191c89c/0xce4472dd2237e3c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.536629:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788930237.537087:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.537095:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000293104fc/0xce4472dd2237e3c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.537106:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.537110:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.537628:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000293104fc/0xce4472dd2237e3c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.537646:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000293104fc/0xce4472dd2237e3c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.537655:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000293104fc/0xce4472dd2237e3c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.537684:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000293104fc/0xce4472dd2237e3c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.537704:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788930237.537719:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788930237.537725:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a191c89c/0xce4472dd2237e3c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.537733:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341e00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930237.537737:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a191c89c/0xce4472dd2237e3c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.537758:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a191c89c/0xce4472dd2237e3c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.537778:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a191c89c/0xce4472dd2237e3c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.537786:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a191c89c/0xce4472dd2237e3c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.537808:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930237.537812:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000293104fc/0xce4472dd2237e3c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.537829:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930237.537832:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000293104fc/0xce4472dd2237e3c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.537839:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000293104fc/0xce4472dd2237e3c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.537850:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000293104fc/0xce4472dd2237e3c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.537857:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000293104fc/0xce4472dd2237e3c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.537872:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.537874:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.537875:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.538992:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.539003:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000333f6c55/0xce4472dd2237e3ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.539016:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.539020:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.539025:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000333f6c55/0xce4472dd2237e3ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.539036:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000333f6c55/0xce4472dd2237e3ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.539052:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000333f6c55/0xce4472dd2237e3ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.539060:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000333f6c55/0xce4472dd2237e3ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.539078:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930237.539091:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930237.539096:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000333f6c55/0xce4472dd2237e3ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.539104:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930237.539108:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000333f6c55/0xce4472dd2237e3ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.539129:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000333f6c55/0xce4472dd2237e3ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.539144:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000333f6c55/0xce4472dd2237e3ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.539152:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000333f6c55/0xce4472dd2237e3ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.539171:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.539179:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.539181:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930237.539572:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.541865:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.541879:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237e3d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.541896:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.541900:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.541906:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237e3d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.541919:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237e3d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.541930:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237e3d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.541938:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237e3d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.541968:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788930237.542081:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788930237.542091:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237e3d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.542101:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340a00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:3.0:1788930237.542107:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237e3d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.542117:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237e3d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.542136:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237e3d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.542145:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006afdc9a2/0xce4472dd2237e3d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.542173:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930237.542176:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930237.542186:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.542475:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.542482:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004085e654/0xce4472dd2237e3dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.542490:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.542494:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.542498:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004085e654/0xce4472dd2237e3dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.542515:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004085e654/0xce4472dd2237e3dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.542524:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004085e654/0xce4472dd2237e3dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.542531:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004085e654/0xce4472dd2237e3dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.542544:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788930237.543029:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.543035:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e715f4d0/0xce4472dd2237e3e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543044:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.543047:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.543050:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e715f4d0/0xce4472dd2237e3e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543059:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e715f4d0/0xce4472dd2237e3e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543067:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e715f4d0/0xce4472dd2237e3e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543087:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e715f4d0/0xce4472dd2237e3e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543106:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788930237.543119:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788930237.543124:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004085e654/0xce4472dd2237e3dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543131:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340e00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930237.543135:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004085e654/0xce4472dd2237e3dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543142:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004085e654/0xce4472dd2237e3dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543156:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004085e654/0xce4472dd2237e3dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543164:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004085e654/0xce4472dd2237e3dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543186:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930237.543189:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e715f4d0/0xce4472dd2237e3e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543208:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340c00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930237.543212:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e715f4d0/0xce4472dd2237e3e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543219:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e715f4d0/0xce4472dd2237e3e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543264:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e715f4d0/0xce4472dd2237e3e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543271:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e715f4d0/0xce4472dd2237e3e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543293:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.543295:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.543298:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.543868:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.543875:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237e3ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543884:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.543887:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.543891:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237e3ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543901:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237e3ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543918:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237e3ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543925:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237e3ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543940:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930237.543951:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930237.543955:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237e3ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.543962:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930237.543966:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237e3ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.546479:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237e3ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.546504:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237e3ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.546512:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080e97449/0xce4472dd2237e3ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.546538:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.546553:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.546624:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930237.546626:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.547795:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.547805:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e3f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.547822:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.547826:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.547833:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e3f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.547849:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e3f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.547860:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e3f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.547870:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e3f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.547893:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788930237.547908:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930237.547913:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e3f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.547921:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930237.547925:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e3f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.547944:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e3f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.547959:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e3f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.547966:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008810e4b5/0xce4472dd2237e3f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.547985:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.547986:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.547988:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.548873:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.548883:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004102f071/0xce4472dd2237e3f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.548894:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.548898:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.548904:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004102f071/0xce4472dd2237e3f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.548913:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004102f071/0xce4472dd2237e3f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.548922:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004102f071/0xce4472dd2237e3f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.548936:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004102f071/0xce4472dd2237e3f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.548956:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788930237.549005:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788930237.549014:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004102f071/0xce4472dd2237e3f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.549025:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:3.0:1788930237.549030:0:18950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004102f071/0xce4472dd2237e3f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.549041:0:18950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004102f071/0xce4472dd2237e3f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.549058:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004102f071/0xce4472dd2237e3f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.549066:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004102f071/0xce4472dd2237e3f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.549092:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930237.549094:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930237.549096:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.549922:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.549931:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007525662d/0xce4472dd2237e3ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.549942:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.549946:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.549951:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007525662d/0xce4472dd2237e3ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.549962:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007525662d/0xce4472dd2237e3ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.549971:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007525662d/0xce4472dd2237e3ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.549979:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007525662d/0xce4472dd2237e3ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.550010:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788930237.550518:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788930237.550526:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007525662d/0xce4472dd2237e3ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.550535:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:3.0:1788930237.550539:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007525662d/0xce4472dd2237e3ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.550631:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007525662d/0xce4472dd2237e3ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.550650:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007525662d/0xce4472dd2237e3ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.550657:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007525662d/0xce4472dd2237e3ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.550681:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930237.550682:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930237.550684:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.551583:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.551592:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8d2d9ee/0xce4472dd2237e406 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.551612:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.551617:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.551622:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d2d9ee/0xce4472dd2237e406 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.551639:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8d2d9ee/0xce4472dd2237e406 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.551648:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8d2d9ee/0xce4472dd2237e406 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.551657:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d2d9ee/0xce4472dd2237e406 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.551677:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788930237.552485:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.552493:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237e40d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.552504:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.552507:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.552511:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237e40d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.552522:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237e40d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.552544:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237e40d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.552551:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237e40d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.552634:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788930237.552652:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788930237.552659:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8d2d9ee/0xce4472dd2237e406 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.552666:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341a00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930237.552670:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8d2d9ee/0xce4472dd2237e406 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.552678:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8d2d9ee/0xce4472dd2237e406 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.552694:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8d2d9ee/0xce4472dd2237e406 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.552702:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8d2d9ee/0xce4472dd2237e406 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.552720:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788930237.552731:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237e40d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.552738:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5340200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930237.552741:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237e40d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.552749:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237e40d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.552759:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237e40d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.552767:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000979ad954/0xce4472dd2237e40d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.552782:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.552784:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.552786:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788930237.553261:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.553543:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.553550:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c81fb88e/0xce4472dd2237e414 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.553630:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.553633:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.553638:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c81fb88e/0xce4472dd2237e414 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.553661:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c81fb88e/0xce4472dd2237e414 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.553671:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c81fb88e/0xce4472dd2237e414 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.553678:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c81fb88e/0xce4472dd2237e414 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.553733:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788930237.554340:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.554347:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078cd069a/0xce4472dd2237e41b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.554357:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.554360:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.554364:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078cd069a/0xce4472dd2237e41b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.554373:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078cd069a/0xce4472dd2237e41b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.554380:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078cd069a/0xce4472dd2237e41b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.554408:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078cd069a/0xce4472dd2237e41b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.557770:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788930237.557789:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c81fb88e/0xce4472dd2237e414 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.557806:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2eb5341000 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:3.0:1788930237.557812:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c81fb88e/0xce4472dd2237e414 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.557824:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c81fb88e/0xce4472dd2237e414 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.557849:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c81fb88e/0xce4472dd2237e414 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.557866:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c81fb88e/0xce4472dd2237e414 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930237.560473:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930237.560489:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078cd069a/0xce4472dd2237e41b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930237.560505:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8566ee00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930237.560510:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078cd069a/0xce4472dd2237e41b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930237.560522:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078cd069a/0xce4472dd2237e41b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930237.560545:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078cd069a/0xce4472dd2237e41b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930237.560554:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930237.560556:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930237.560559:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930237.560778:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788930237.560788:0:19646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078cd069a/0xce4472dd2237e41b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930237.561489:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788930237.561924:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788930237.561933:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecc92548/0xce4472dd2237e422 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.561948:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788930237.561953:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930237.561960:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecc92548/0xce4472dd2237e422 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.561975:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecc92548/0xce4472dd2237e422 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.561985:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecc92548/0xce4472dd2237e422 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.561993:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecc92548/0xce4472dd2237e422 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930237.562025:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788930237.562039:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788930237.562047:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecc92548/0xce4472dd2237e422 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930237.562057:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8566e600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930237.562062:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecc92548/0xce4472dd2237e422 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930237.562073:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecc92548/0xce4472dd2237e422 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930237.562092:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecc92548/0xce4472dd2237e422 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930237.562107:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecc92548/0xce4472dd2237e422 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930237.562123:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930237.562126:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930237.562127:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788930237.564791:0:19646:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1788930237.564956:0:19646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:18986:x1875828770212736:12345-0@lo:5:osp-pre-1-0.0 Request processed in 142356us (145497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930237.564968:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788930237.565692:0:18986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2ebbff8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18986:1875828770212736:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788930237.565712:0:18986:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788930237.565858:0:18986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d85134a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18986:1875828770212864:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788930237.565916:0:18986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930237.566012:0:18986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e90a896c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788930237.566055:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770212864 00000100:00100000:3.0:1788930237.566063:0:19647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770212864 00000100:00100000:3.0:1788930237.566150:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788930237.566161:0:19647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18986:x1875828770212864:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788930237.566257:0:19647:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:3.0:1788930237.572877:0:19647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:18986:x1875828770212864:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6709us (6951us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788930237.572893:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788930237.581734:0:18986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d85134a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18986:1875828770212864:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788930237.581757:0:18986:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1788930237.916136:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770212992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788930237.916218:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930237.916315:0:19649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770212992 00000100:00100000:1.0:1788930237.916323:0:19649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770212992 00000100:00100000:1.0:1788930237.916368:0:19649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788930237.916377:0:19649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770212992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788930237.916424:0:19649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788930237.916469:0:19649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770212992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930237.916476:0:19649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788930237.916528:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770212992:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788930238.302768:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930239.328427:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788930240.193536:0:20717:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788930240.358447:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930241.371790:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930242.405731:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930242.472832:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930242.472938:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747146752 00000100:00100000:3.0:1788930242.472949:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747146752 00000100:00100000:3.0:1788930242.472998:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 75 00000100:00100000:3.0:1788930242.473009:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1875828747146752:12345-192.168.204.40@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788930242.473042:0:18956:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 54fa4f43-feb8-4641-8502-e0f8083e1215@192.168.204.40@tcp t0 exp 0000000000000000 cur 627 last 0 00000020:00000080:3.0:1788930242.473076:0:18956:0:(genops.c:1384:class_connect()) connect: client 54fa4f43-feb8-4641-8502-e0f8083e1215, cookie 0xce4472dd2237e429 00000100:00080000:3.0:1788930242.473210:0:18956:0:(import.c:65:import_set_state_nolock()) ffff8d2ebefd1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788930242.473340:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+5:2358:x1875828747146752:12345-192.168.204.40@tcp:250:mount.lustre.0 Request processed in 331us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930242.473348:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 75 00000100:00100000:1.0:1788930242.480799:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930242.480904:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747146880 00000100:00100000:0.0:1788930242.480915:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747146880 00000100:00100000:0.0:1788930242.480983:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 76 00000100:00100000:0.0:1788930242.480992:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+5:16784:x1875828747146880:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788930242.481025:0:18955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930242.481044:0:18955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebe0b9000/0xce4472dd2237e430 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca71640210738 expref: -99 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930242.481074:0:18955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebe0b9000/0xce4472dd2237e430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210738 expref: 6 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930242.481086:0:18955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebe0b9000/0xce4472dd2237e430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210738 expref: 6 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930242.481100:0:18955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9000, rc 0) 00000100:00100000:0.0:1788930242.481158:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+6:16784:x1875828747146880:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 167us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930242.481165:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 76 00000100:00100000:1.0:1788930242.486731:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930242.487002:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747147008 00000100:00100000:0.0:1788930242.487020:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747147008 00000100:00100000:0.0:1788930242.487152:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 77 00000100:00100000:0.0:1788930242.487163:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+6:16784:x1875828747147008:12345-192.168.204.40@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788930242.487622:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+6:16784:x1875828747147008:12345-192.168.204.40@tcp:501:mount.lustre.0 Request processed in 460us (901us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788930242.487631:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 77 00000100:00100000:1.0:1788930242.493713:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930242.493864:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747147136 00000100:00100000:3.0:1788930242.493874:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747147136 00000100:00100000:3.0:1788930242.493941:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 78 00000100:00100000:3.0:1788930242.493953:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+6:16784:x1875828747147136:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788930242.493971:0:18956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930242.493989:0:18956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc596000/0xce4472dd2237e437 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca7164021073f expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930242.494017:0:18956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc596000/0xce4472dd2237e437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021073f expref: 7 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930242.494028:0:18956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc596000/0xce4472dd2237e437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021073f expref: 7 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930242.494037:0:18956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596000, rc 0) 00000100:00100000:3.0:1788930242.494094:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+7:16784:x1875828747147136:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 144us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930242.494101:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 78 00000100:00100000:1.0:1788930242.503703:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930242.503850:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747147264 00000100:00100000:0.0:1788930242.503862:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747147264 00000100:00100000:0.0:1788930242.503966:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 79 00000100:00100000:0.0:1788930242.503978:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+7:16784:x1875828747147264:12345-192.168.204.40@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788930242.504341:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+8:16784:x1875828747147264:12345-192.168.204.40@tcp:501:mount.lustre.0 Request processed in 365us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930242.504358:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 79 00000100:00100000:1.0:1788930242.508645:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930242.509133:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747147392 00000100:00100000:0.0:1788930242.509153:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747147392 00000100:00100000:0.0:1788930242.509215:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 80 00000100:00100000:0.0:1788930242.509264:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+8:16784:x1875828747147392:12345-192.168.204.40@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788930242.512092:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+8:16784:x1875828747147392:12345-192.168.204.40@tcp:503:mount.lustre.0 Request processed in 2856us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930242.512109:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 80 00000100:00100000:1.0:1788930242.515759:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930242.515861:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747147520 00000100:00100000:0.0:1788930242.515876:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747147520 00000100:00100000:0.0:1788930242.515934:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 81 00000100:00100000:0.0:1788930242.515945:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+8:16802:x1875828747147520:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788930242.516371:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+8:16802:x1875828747147520:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 427us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930242.516379:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 81 00000100:00100000:1.0:1788930242.528601:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770213120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788930242.528688:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930242.528746:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770213632:0@lo:400:kworker.0 00000100:00100000:1.0:1788930242.528769:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930242.528795:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788930242.528801:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c52ce1e4-e465-4485-9875-0a24e445f9ec:3310:1875828770213248:0@lo:400:kworker.0 00000100:00100000:1.0:1788930242.528831:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930242.528852:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770213760:0@lo:400:kworker.0 00000100:00100000:1.0:1788930242.528872:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930242.528901:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770213376:0@lo:400:kworker.0 00000100:00100000:1.0:1788930242.528923:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930242.528941:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770213888:0@lo:400:kworker.0 00000100:00100000:1.0:1788930242.528965:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930242.528983:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788930242.528988:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770213504:0@lo:400:kworker.0 00000100:00100000:1.0:1788930242.529006:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930242.529057:0:19649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770213120 00000100:00100000:1.0:1788930242.529064:0:19649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770213120 00000100:00100000:1.0:1788930242.529120:0:19649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788930242.529129:0:19649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875828770213120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788930242.529188:0:19649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788930242.529262:0:19649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875828770213120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930242.529269:0:19649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788930242.529293:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770213632 00000100:00100000:1.0:1788930242.529307:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770213632 00000100:00100000:1.0:1788930242.529325:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770213760 00000100:00100000:1.0:1788930242.529328:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770213760 00000100:00100000:1.0:1788930242.529340:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770213888 00000100:00100000:1.0:1788930242.529342:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770213888 00000100:00100000:1.0:1788930242.529353:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788930242.529359:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770213632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930242.529391:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875828770213632:12345-0@lo:400:kworker.0 Request processed in 31us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930242.529398:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788930242.529409:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788930242.529415:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770213760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930242.529437:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875828770213760:12345-0@lo:400:kworker.0 Request processed in 23us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930242.529442:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788930242.529452:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788930242.529457:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770213888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930242.529483:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875828770213888:12345-0@lo:400:kworker.0 Request processed in 26us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930242.529489:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788930242.529507:0:20132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770213376 00000100:00100000:1.0:1788930242.529510:0:20132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770213376 00000100:00100000:1.0:1788930242.529538:0:20132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770213504 00000100:00100000:1.0:1788930242.529541:0:20132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770213504 00000100:00100000:1.0:1788930242.529555:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788930242.529561:0:20132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770213376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930242.529588:0:20132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770213376:12345-0@lo:400:kworker.0 Request processed in 28us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930242.529594:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788930242.529603:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788930242.529608:0:20132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1875828770213504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930242.529629:0:20132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1875828770213504:12345-0@lo:400:kworker.0 Request processed in 21us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930242.529634:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788930242.529652:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788930242.529657:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788930242.529659:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788930242.529693:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770213504:0@lo:400:kworker.0 00000100:00100000:1.0:1788930242.529702:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770213376:0@lo:400:kworker.0 00010000:00080000:1.0:1788930242.529712:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e9837f100 x1875828770213888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788930242.529723:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875828770213888:0@lo:400:kworker.0 00010000:00080000:1.0:1788930242.529751:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e9837c700 x1875828770213760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788930242.529759:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875828770213760:0@lo:400:kworker.0 00000100:00100000:1.0:1788930242.529771:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770213120:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788930242.529779:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d2e9837f480 x1875828770213632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788930258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788930242.529793:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875828770213632:0@lo:400:kworker.0 00000100:00100000:1.0:1788930242.529811:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770213248 00000100:00100000:1.0:1788930242.529815:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770213248 00000100:00100000:1.0:1788930242.529839:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788930242.529845:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:3310:x1875828770213248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930242.529878:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:3310:x1875828770213248:12345-0@lo:400:kworker.0 Request processed in 33us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930242.529883:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788930242.529916:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c52ce1e4-e465-4485-9875-0a24e445f9ec:3310:1875828770213248:0@lo:400:kworker.0 00000100:00100000:1.0:1788930242.531387:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930242.531860:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747147648 00000100:00100000:2.0:1788930242.531871:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747147648 00000100:00100000:2.0:1788930242.531919:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 83 00000100:00100000:2.0:1788930242.531929:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+8:16802:x1875828747147648:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788930242.534943:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+8:16802:x1875828747147648:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 2999us (3548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930242.534961:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 83 00000100:00100000:1.0:1788930242.552310:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930242.552359:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747147776 00000100:00100000:1.0:1788930242.552371:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747147776 00000100:00100000:1.0:1788930242.552427:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 84 00000100:00100000:1.0:1788930242.552438:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+8:16784:x1875828747147776:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788930242.552457:0:18954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930242.552477:0:18954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d86a75000/0xce4472dd2237e43e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca71640210769 expref: -99 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930242.552509:0:18954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d86a75000/0xce4472dd2237e43e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210769 expref: 9 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930242.552520:0:18954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d86a75000/0xce4472dd2237e43e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210769 expref: 9 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930242.552530:0:18954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a75000, rc 0) 00000100:00100000:1.0:1788930242.552597:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+9:16784:x1875828747147776:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 161us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930242.552605:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 84 00000100:00100000:1.0:1788930242.568004:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930242.568085:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747147904 00000100:00100000:2.0:1788930242.568098:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747147904 00000100:00100000:2.0:1788930242.568186:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 85 00000100:00100000:2.0:1788930242.568197:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+9:16784:x1875828747147904:12345-192.168.204.40@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788930242.568242:0:18956:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788930242.568266:0:18956:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788930242.568269:0:18956:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788930242.568278:0:18956:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788930242.568280:0:18956:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:2.0:1788930242.574050:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+9:16784:x1875828747147904:12345-192.168.204.40@tcp:256:mount.lustre.0 Request processed in 5845us (6044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930242.574066:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 85 00000100:00100000:0.0:1788930242.580661:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930242.580964:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747148032 00000100:00100000:1.0:1788930242.580975:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747148032 00000100:00100000:1.0:1788930242.581037:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 86 00000100:00100000:1.0:1788930242.581050:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+9:16784:x1875828747148032:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788930242.581068:0:18955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930242.581088:0:18955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d86a74400/0xce4472dd2237e445 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca71640210770 expref: -99 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930242.581120:0:18955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d86a74400/0xce4472dd2237e445 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210770 expref: 10 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930242.581132:0:18955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d86a74400/0xce4472dd2237e445 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210770 expref: 10 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930242.581141:0:18955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a74400, rc 0) 00000100:00100000:1.0:1788930242.581195:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+10:16784:x1875828747148032:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 148us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930242.581202:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 86 00000100:00100000:1.0:1788930242.587422:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930242.587467:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747148160 00000100:00100000:1.0:1788930242.587477:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747148160 00000100:00100000:1.0:1788930242.587532:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 87 00000100:00100000:1.0:1788930242.587543:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+10:16784:x1875828747148160:12345-192.168.204.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788930242.587853:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+10:16784:x1875828747148160:12345-192.168.204.40@tcp:501:mount.lustre.0 Request processed in 310us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930242.587862:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 87 00000100:00100000:1.0:1788930242.592536:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930242.592728:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747148288 00000100:00100000:3.0:1788930242.592739:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747148288 00000100:00100000:3.0:1788930242.592799:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 88 00000100:00100000:3.0:1788930242.592810:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+10:16784:x1875828747148288:12345-192.168.204.40@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788930242.593179:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+10:16784:x1875828747148288:12345-192.168.204.40@tcp:503:mount.lustre.0 Request processed in 369us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930242.593188:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 88 00000100:00100000:0.0:1788930242.601516:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930242.601609:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747148416 00000100:00100000:3.0:1788930242.601621:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747148416 00000100:00100000:3.0:1788930242.601686:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 89 00000100:00100000:3.0:1788930242.601708:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+10:16804:x1875828747148416:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788930242.602016:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+10:16804:x1875828747148416:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 308us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930242.602025:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 89 00000001:00100000:1.0:1788930242.605672:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788930242.605752:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000100:00100000:1.0:1788930242.606292:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930242.606428:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747148544 00000100:00100000:3.0:1788930242.606440:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747148544 00000100:00100000:3.0:1788930242.606497:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 90 00000100:00100000:3.0:1788930242.606507:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+10:16804:x1875828747148544:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788930242.606776:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+10:16804:x1875828747148544:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 270us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930242.606786:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 90 00000100:00100000:0.0:1788930242.613139:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930242.613310:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747148672 00000100:00100000:1.0:1788930242.613321:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747148672 00000100:00100000:1.0:1788930242.613375:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:1.0:1788930242.613385:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1875828747148672:12345-192.168.204.40@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788930242.613419:0:18962:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from f6beff19-9e3f-4b9a-94ae-af74e13e7978@192.168.204.40@tcp t0 exp 0000000000000000 cur 627 last 0 00000020:00000080:1.0:1788930242.613471:0:18962:0:(genops.c:1384:class_connect()) connect: client f6beff19-9e3f-4b9a-94ae-af74e13e7978, cookie 0xce4472dd2237e44c 00000004:00100000:1.0:1788930242.613506:0:18962:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788930242.613513:0:18962:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:1.0:1788930242.663492:0:18962:0:(import.c:65:import_set_state_nolock()) ffff8d2eb544d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788930242.663575:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:2358:x1875828747148672:12345-192.168.204.40@tcp:38:mount.lustre.0 Request processed in 50189us (50447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930242.663587:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:0.0:1788930242.668213:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930242.668393:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747148928 00000100:00100000:1.0:1788930242.668404:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747148928 00000100:00100000:1.0:1788930242.668482:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:1.0:1788930242.668494:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:16784:x1875828747148928:12345-192.168.204.40@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788930242.668542:0:18963:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788930242.668640:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:16784:x1875828747148928:12345-192.168.204.40@tcp:41:mount.lustre.0 Request processed in 148us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930242.668664:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:3.0:1788930242.668868:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930242.668988:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747148800 00000100:00100000:2.0:1788930242.668994:0:18961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747148800 00000100:00100000:2.0:1788930242.669027:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:2.0:1788930242.669035:0:18961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:0:x1875828747148800:12345-192.168.204.40@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788930242.669050:0:18961:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1788930242.669109:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788930242.670830:0:18961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:0:x1875828747148800:12345-192.168.204.40@tcp:41:mount.lustre.0 Request processed in 1780us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930242.670843:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:2.0:1788930242.672607:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930242.672687:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747149056 00000100:00100000:1.0:1788930242.672698:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747149056 00000100:00100000:1.0:1788930242.672799:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:1.0:1788930242.672811:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:16784:x1875828747149056:12345-192.168.204.40@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788930242.672906:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:16784:x1875828747149056:12345-192.168.204.40@tcp:40:mount.lustre.0 Request processed in 97us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930242.672914:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:0.0:1788930242.675693:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930242.675736:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930242.675822:0:19645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747149184 00000100:00100000:2.0:1788930242.675832:0:19645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747149184 00000100:00100000:2.0:1788930242.675871:0:19645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747149312 00000100:00100000:2.0:1788930242.675873:0:19645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747149312 00000100:00100000:2.0:1788930242.675898:0:19645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:2.0:1788930242.675907:0:19645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1875828747149184:12345-192.168.204.40@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788930242.675941:0:19645:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f6beff19-9e3f-4b9a-94ae-af74e13e7978@192.168.204.40@tcp t0 exp 0000000000000000 cur 627 last 0 00000020:00000080:2.0:1788930242.675976:0:19645:0:(genops.c:1384:class_connect()) connect: client f6beff19-9e3f-4b9a-94ae-af74e13e7978, cookie 0xce4472dd2237e453 00002000:00100000:2.0:1788930242.675989:0:19645:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f6beff19-9e3f-4b9a-94ae-af74e13e7978/ffff8d2ebc976000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788930242.676016:0:19645:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788930242.676563:0:19645:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788930242.676601:0:19645:0:(import.c:65:import_set_state_nolock()) ffff8d2ebc971000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788930242.676685:0:19645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:2358:x1875828747149184:12345-192.168.204.40@tcp:8:mount.lustre.0 Request processed in 777us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930242.676693:0:19645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:2.0:1788930242.676715:0:19645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:2.0:1788930242.676721:0:19645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2ebbff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1875828747149312:12345-192.168.204.40@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788930242.676741:0:19645:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f6beff19-9e3f-4b9a-94ae-af74e13e7978@192.168.204.40@tcp t0 exp 0000000000000000 cur 627 last 0 00000020:00000080:2.0:1788930242.676761:0:19645:0:(genops.c:1384:class_connect()) connect: client f6beff19-9e3f-4b9a-94ae-af74e13e7978, cookie 0xce4472dd2237e45a 00002000:00100000:2.0:1788930242.676768:0:19645:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f6beff19-9e3f-4b9a-94ae-af74e13e7978/ffff8d2ebc974800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788930242.676775:0:19645:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788930242.676991:0:19645:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788930242.677006:0:19645:0:(import.c:65:import_set_state_nolock()) ffff8d2ebc976800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788930242.678455:0:19645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2ebbff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:2358:x1875828747149312:12345-192.168.204.40@tcp:8:mount.lustre.0 Request processed in 1724us (2709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930242.678468:0:19645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:0.0:1788930242.679311:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930242.679422:0:18964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747149440 00000100:00100000:3.0:1788930242.679433:0:18964:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747149440 00000100:00100000:3.0:1788930242.679485:0:18964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:3.0:1788930242.679495:0:18964:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:16784:x1875828747149440:12345-192.168.204.40@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788930242.681240:0:18964:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1659us 00000004:00200000:3.0:1788930242.694131:0:18964:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788930242.694275:0:18964:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:16784:x1875828747149440:12345-192.168.204.40@tcp:33:mount.lustre.0 Request processed in 14774us (14960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930242.694287:0:18964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:2.0:1788930242.857599:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930242.857746:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747149568 00000100:00100000:0.0:1788930242.857768:0:18961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747149568 00000100:00100000:0.0:1788930242.857840:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:0.0:1788930242.857851:0:18961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:16825:x1875828747149568:12345-192.168.204.40@tcp:101:mkdir.0 00010000:00010000:0.0:1788930242.857872:0:18961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930242.857911:0:18961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9400/0xce4472dd2237e461 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021079a expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930242.857977:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237e468 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930242.857991:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237e468 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930242.858006:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237e468 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788930242.858053:0:18961:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788930242.858057:0:18961:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788930242.858099:0:18961:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237e468 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930242.858466:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9400/0xce4472dd2237e461 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021079a expref: 8 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930242.858494:0:18961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237e468 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021079a expref: 7 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930242.858502:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4a00) 00010000:00010000:0.0:1788930242.858504:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788930242.858508:0:18961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8600, rc 0) 00000100:00100000:0.0:1788930242.858577:0:18961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+7:16825:x1875828747149568:12345-192.168.204.40@tcp:101:mkdir.0 Request processed in 728us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930242.858584:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:0.0:1788930243.038992:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770214016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788930243.039521:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930243.039600:0:19649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770214016 00000100:00100000:0.0:1788930243.039609:0:19649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770214016 00000100:00100000:0.0:1788930243.039653:0:19649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788930243.039662:0:19649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770214016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788930243.039686:0:19649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788930243.039729:0:19649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770214016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930243.039736:0:19649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788930243.039798:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770214016:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1788930243.197888:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f6beff19-9e3f-4b9a-94ae-af74e13e7978 00010000:00010000:0.0:1788930243.420613:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930244.444322:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788930244.953380:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930244.953485:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747149696 00000100:00100000:1.0:1788930244.953495:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747149696 00000100:00100000:1.0:1788930244.953566:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:1.0:1788930244.953577:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+7:16877:x1875828747149696:12345-192.168.204.40@tcp:41:lfs.0 00000004:00000024:1.0:1788930244.953624:0:18962:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788930244.953738:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+7:16877:x1875828747149696:12345-192.168.204.40@tcp:41:lfs.0 Request processed in 162us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930244.953747:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00080000:0.0:1788930244.953823:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788930244.961657:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930244.961761:0:19649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747149824 00000100:00100000:0.0:1788930244.961772:0:19649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747149824 00000100:00100000:0.0:1788930244.961880:0:19649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:0.0:1788930244.961894:0:19649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f6beff19-9e3f-4b9a-94ae-af74e13e7978+5:16877:x1875828747149824:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:0.0:1788930244.961943:0:19649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1788930244.962029:0:19649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f6beff19-9e3f-4b9a-94ae-af74e13e7978+5:16877:x1875828747149824:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 138us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930244.962036:0:19649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00080000:1.0:1788930244.963212:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788930244.974516:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930244.975720:0:19649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747149952 00000100:00100000:0.0:1788930244.975735:0:19649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747149952 00000100:00100000:0.0:1788930244.975825:0:19649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:0.0:1788930244.975836:0:19649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:16877:x1875828747149952:12345-192.168.204.40@tcp:13:lfs.0 00002000:00000024:0.0:1788930244.975896:0:19649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788930244.976009:0:19649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:16877:x1875828747149952:12345-192.168.204.40@tcp:13:lfs.0 Request processed in 174us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930244.976017:0:19649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00080000:1.0:1788930244.982029:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1788930245.022510:0:18994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788930245.155470:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930245.155646:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747150080 00000100:00100000:0.0:1788930245.155656:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747150080 00000100:00100000:0.0:1788930245.155721:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 91 00000100:00100000:0.0:1788930245.155731:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+10:16909:x1875828747150080:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788930245.155748:0:18954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930245.155766:0:18954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebe0b9400/0xce4472dd2237e46f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca716402107a1 expref: -99 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930245.155799:0:18954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebe0b9400/0xce4472dd2237e46f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402107a1 expref: 11 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930245.155810:0:18954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebe0b9400/0xce4472dd2237e46f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402107a1 expref: 11 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930245.155818:0:18954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9400, rc 0) 00000100:00100000:0.0:1788930245.155901:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+11:16909:x1875828747150080:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 171us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930245.155917:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 91 00000100:00100000:2.0:1788930245.158333:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930245.158427:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747150208 00000100:00100000:1.0:1788930245.158437:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747150208 00000100:00100000:1.0:1788930245.158493:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 92 00000100:00100000:1.0:1788930245.158502:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+11:16909:x1875828747150208:12345-192.168.204.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788930245.159129:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+11:16909:x1875828747150208:12345-192.168.204.40@tcp:501:mount.lustre.0 Request processed in 624us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930245.159151:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 92 00000100:00100000:2.0:1788930245.164216:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930245.164497:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747150336 00000100:00100000:3.0:1788930245.164526:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747150336 00000100:00100000:3.0:1788930245.164584:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 93 00000100:00100000:3.0:1788930245.164594:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+11:16909:x1875828747150336:12345-192.168.204.40@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788930245.165384:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+11:16909:x1875828747150336:12345-192.168.204.40@tcp:503:mount.lustre.0 Request processed in 784us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930245.165395:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 93 00000100:00100000:3.0:1788930245.174607:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930245.174718:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747150464 00000100:00100000:0.0:1788930245.174739:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747150464 00000100:00100000:0.0:1788930245.174797:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 94 00000100:00100000:0.0:1788930245.174808:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+11:16915:x1875828747150464:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788930245.175161:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+11:16915:x1875828747150464:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 354us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930245.175477:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 94 00000100:00100000:2.0:1788930245.222604:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930245.224047:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747150592 00000100:00100000:1.0:1788930245.224064:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747150592 00000100:00100000:1.0:1788930245.224148:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 95 00000100:00100000:1.0:1788930245.224159:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+11:16915:x1875828747150592:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788930245.224506:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+11:16915:x1875828747150592:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 348us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930245.224515:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 95 00000100:00100000:2.0:1788930245.234930:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930245.235301:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747150720 00000100:00100000:3.0:1788930245.235315:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747150720 00000100:00100000:3.0:1788930245.235378:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 96 00000100:00100000:3.0:1788930245.235389:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+11:16909:x1875828747150720:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788930245.235407:0:18956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930245.235423:0:18956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc596e00/0xce4472dd2237e476 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca716402107cb expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930245.235455:0:18956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc596e00/0xce4472dd2237e476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402107cb expref: 12 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930245.235467:0:18956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc596e00/0xce4472dd2237e476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402107cb expref: 12 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930245.235476:0:18956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596e00, rc 0) 00000100:00100000:3.0:1788930245.235542:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+12:16909:x1875828747150720:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 154us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930245.235550:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 96 00000100:00100000:3.0:1788930245.246338:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930245.246828:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747150848 00000100:00100000:0.0:1788930245.246840:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747150848 00000100:00100000:0.0:1788930245.246911:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 97 00000100:00100000:0.0:1788930245.246922:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+12:16909:x1875828747150848:12345-192.168.204.40@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788930245.246949:0:18954:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788930245.246975:0:18954:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788930245.246980:0:18954:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788930245.246983:0:18954:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788930245.246986:0:18954:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:0.0:1788930245.255819:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+12:16909:x1875828747150848:12345-192.168.204.40@tcp:256:mount.lustre.0 Request processed in 8888us (9480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930245.255835:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 97 00000100:00100000:2.0:1788930245.262184:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930245.262301:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747150976 00000100:00100000:1.0:1788930245.262314:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747150976 00000100:00100000:1.0:1788930245.262384:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 98 00000100:00100000:1.0:1788930245.262394:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+12:16909:x1875828747150976:12345-192.168.204.40@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788930245.262410:0:18955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930245.262428:0:18955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d86a74c00/0xce4472dd2237e47d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca716402107d2 expref: -99 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930245.262459:0:18955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d86a74c00/0xce4472dd2237e47d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402107d2 expref: 13 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930245.262469:0:18955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d86a74c00/0xce4472dd2237e47d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402107d2 expref: 13 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930245.262478:0:18955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a74c00, rc 0) 00000100:00100000:1.0:1788930245.262538:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+13:16909:x1875828747150976:12345-192.168.204.40@tcp:101:mount.lustre.0 Request processed in 145us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930245.262546:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 98 00000100:00100000:3.0:1788930245.265951:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930245.266219:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747151104 00000100:00100000:0.0:1788930245.266277:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747151104 00000100:00100000:0.0:1788930245.266351:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 99 00000100:00100000:0.0:1788930245.266362:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8456f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+13:16909:x1875828747151104:12345-192.168.204.40@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788930245.266863:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8456f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+13:16909:x1875828747151104:12345-192.168.204.40@tcp:501:mount.lustre.0 Request processed in 500us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930245.266872:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 99 00000100:00100000:2.0:1788930245.274613:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930245.274697:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747151232 00000100:00100000:3.0:1788930245.274707:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747151232 00000100:00100000:3.0:1788930245.274764:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 100 00000100:00100000:3.0:1788930245.274775:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+13:16909:x1875828747151232:12345-192.168.204.40@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788930245.275056:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84572450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+13:16909:x1875828747151232:12345-192.168.204.40@tcp:503:mount.lustre.0 Request processed in 282us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930245.275065:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 100 00000100:00100000:2.0:1788930245.282470:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930245.282905:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747151360 00000100:00100000:1.0:1788930245.282916:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747151360 00000100:00100000:1.0:1788930245.283040:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 101 00000100:00100000:1.0:1788930245.283053:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+13:16918:x1875828747151360:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788930245.283348:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84572c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+13:16918:x1875828747151360:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 298us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930245.283357:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 101 00000100:00100000:0.0:1788930245.292440:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930245.297869:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747151488 00000100:00100000:3.0:1788930245.297887:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747151488 00000100:00100000:3.0:1788930245.297957:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 102 00000100:00100000:3.0:1788930245.297967:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84570c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+13:16918:x1875828747151488:12345-192.168.204.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788930245.298468:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84570c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+13:16918:x1875828747151488:12345-192.168.204.40@tcp:502:llog_process_th.0 Request processed in 500us (6036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930245.298478:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 102 00000100:00100000:2.0:1788930245.303095:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930245.303137:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930245.303173:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930245.303275:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930245.303309:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747152256 00000100:00100000:2.0:1788930245.303319:0:19647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747152256 00000100:00100000:2.0:1788930245.303368:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747152128 00000100:00100000:2.0:1788930245.303371:0:19647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747152128 00000100:00100000:2.0:1788930245.303394:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:2.0:1788930245.303405:0:19647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:2362:x1875828747152256:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930245.303492:0:19647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:2362:x1875828747152256:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 89us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930245.303501:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:2.0:1788930245.303517:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:2.0:1788930245.303524:0:19647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+5:2362:x1875828747152128:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930245.303558:0:19647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+5:2362:x1875828747152128:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 35us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930245.303564:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:1.0:1788930245.303872:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747151616 00000100:00100000:1.0:1788930245.303877:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747151616 00000100:00100000:1.0:1788930245.303904:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747152000 00000100:00100000:1.0:1788930245.303907:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747152000 00000100:00100000:1.0:1788930245.303924:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:1.0:1788930245.303930:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+7:2362:x1875828747152000:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788930245.303959:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+7:2362:x1875828747152000:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 29us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930245.303966:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:1.0:1788930245.303979:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:1.0:1788930245.303983:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d85136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1875828747151616:12345-192.168.204.40@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788930245.304007:0:18962:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from a847aba8-b811-46f0-8caf-0cdd775ee205@192.168.204.40@tcp t0 exp 0000000000000000 cur 630 last 0 00000020:00000080:1.0:1788930245.304042:0:18962:0:(genops.c:1384:class_connect()) connect: client a847aba8-b811-46f0-8caf-0cdd775ee205, cookie 0xce4472dd2237e484 00000004:00100000:1.0:1788930245.304085:0:18962:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788930245.304199:0:18962:0:(import.c:65:import_set_state_nolock()) ffff8d2d8482e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788930245.304264:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d85136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a847aba8-b811-46f0-8caf-0cdd775ee205+6:2358:x1875828747151616:12345-192.168.204.40@tcp:38:mount.lustre.0 Request processed in 278us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930245.304271:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:1.0:1788930245.317154:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930245.317197:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930245.318197:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747151872 00000100:00100000:3.0:1788930245.318211:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747151872 00000100:00100000:3.0:1788930245.318375:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747151744 00000100:00100000:3.0:1788930245.318379:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747151744 00000100:00100000:3.0:1788930245.318399:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:3.0:1788930245.318408:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a847aba8-b811-46f0-8caf-0cdd775ee205+7:16909:x1875828747151872:12345-192.168.204.40@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788930245.318439:0:18963:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788930245.318509:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a847aba8-b811-46f0-8caf-0cdd775ee205+7:16909:x1875828747151872:12345-192.168.204.40@tcp:41:mount.lustre.0 Request processed in 101us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930245.318519:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:3.0:1788930245.318537:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:3.0:1788930245.318543:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a847aba8-b811-46f0-8caf-0cdd775ee205+6:0:x1875828747151744:12345-192.168.204.40@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788930245.318568:0:18963:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788930245.318593:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a847aba8-b811-46f0-8caf-0cdd775ee205+6:0:x1875828747151744:12345-192.168.204.40@tcp:41:mount.lustre.0 Request processed in 50us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930245.318599:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00080000:1.0:1788930245.319266:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788930245.321990:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930245.325148:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747152384 00000100:00100000:3.0:1788930245.325166:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747152384 00000100:00100000:2.0:1788930245.325507:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:2.0:1788930245.325519:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a847aba8-b811-46f0-8caf-0cdd775ee205+6:16909:x1875828747152384:12345-192.168.204.40@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788930245.325625:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a847aba8-b811-46f0-8caf-0cdd775ee205+6:16909:x1875828747152384:12345-192.168.204.40@tcp:40:mount.lustre.0 Request processed in 108us (3643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930245.325632:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:2.0:1788930245.330633:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930245.331364:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930245.331403:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930245.331484:0:20132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747152512 00000100:00100000:3.0:1788930245.331505:0:20132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747152512 00000100:00100000:3.0:1788930245.331548:0:20132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747152640 00000100:00100000:3.0:1788930245.331551:0:20132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747152640 00000100:00100000:3.0:1788930245.331573:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:3.0:1788930245.331582:0:20132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88160a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2358:x1875828747152512:12345-192.168.204.40@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788930245.331616:0:20132:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from a847aba8-b811-46f0-8caf-0cdd775ee205@192.168.204.40@tcp t0 exp 0000000000000000 cur 630 last 0 00000020:00000080:3.0:1788930245.331650:0:20132:0:(genops.c:1384:class_connect()) connect: client a847aba8-b811-46f0-8caf-0cdd775ee205, cookie 0xce4472dd2237e48b 00002000:00100000:3.0:1788930245.331663:0:20132:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a847aba8-b811-46f0-8caf-0cdd775ee205/ffff8d2d84b5c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788930245.331676:0:20132:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788930245.331925:0:20132:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788930245.331956:0:20132:0:(import.c:65:import_set_state_nolock()) ffff8d2d84b5d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788930245.332022:0:20132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88160a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a847aba8-b811-46f0-8caf-0cdd775ee205+6:2358:x1875828747152512:12345-192.168.204.40@tcp:8:mount.lustre.0 Request processed in 439us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930245.332030:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:3.0:1788930245.332046:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:3.0:1788930245.332065:0:20132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2358:x1875828747152640:12345-192.168.204.40@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788930245.332082:0:20132:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from a847aba8-b811-46f0-8caf-0cdd775ee205@192.168.204.40@tcp t0 exp 0000000000000000 cur 630 last 0 00000020:00000080:3.0:1788930245.332097:0:20132:0:(genops.c:1384:class_connect()) connect: client a847aba8-b811-46f0-8caf-0cdd775ee205, cookie 0xce4472dd2237e492 00002000:00100000:3.0:1788930245.332115:0:20132:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a847aba8-b811-46f0-8caf-0cdd775ee205/ffff8d2d84b5a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788930245.332122:0:20132:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788930245.332167:0:20132:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788930245.332183:0:20132:0:(import.c:65:import_set_state_nolock()) ffff8d2d84b5b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788930245.332207:0:20132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a847aba8-b811-46f0-8caf-0cdd775ee205+6:2358:x1875828747152640:12345-192.168.204.40@tcp:8:mount.lustre.0 Request processed in 154us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930245.332214:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:1.0:1788930245.334984:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747152768 00000100:00100000:1.0:1788930245.335001:0:18965:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747152768 00000100:00100000:1.0:1788930245.335578:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1 00000100:00100000:1.0:1788930245.335592:0:18965:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a847aba8-b811-46f0-8caf-0cdd775ee205+6:16909:x1875828747152768:12345-192.168.204.40@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788930245.335675:0:18965:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788930245.335782:0:18965:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a847aba8-b811-46f0-8caf-0cdd775ee205+6:16909:x1875828747152768:12345-192.168.204.40@tcp:33:mount.lustre.0 Request processed in 194us (5159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930245.335789:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1 00010000:00010000:0.0:1788930245.468026:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930245.505348:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930245.505495:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747152896 00000100:00100000:2.0:1788930245.505505:0:18961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747152896 00000100:00100000:2.0:1788930245.505567:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:2.0:1788930245.505578:0:18961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a847aba8-b811-46f0-8caf-0cdd775ee205+6:16939:x1875828747152896:12345-192.168.204.40@tcp:101:mkdir.0 00010000:00010000:2.0:1788930245.505607:0:18961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930245.505630:0:18961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e000/0xce4472dd2237e499 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402107fc expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930245.505699:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f000/0xce4472dd2237e4a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930245.505713:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f000/0xce4472dd2237e4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930245.505725:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f000/0xce4472dd2237e4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788930245.505764:0:18961:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788930245.505768:0:18961:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788930245.505791:0:18961:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f000/0xce4472dd2237e4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930245.506077:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e000/0xce4472dd2237e499 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402107fc expref: 8 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930245.506097:0:18961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f000/0xce4472dd2237e4a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402107fc expref: 7 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930245.506105:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4a00) 00010000:00010000:2.0:1788930245.506108:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788930245.506112:0:18961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8566f000, rc 0) 00000100:00100000:2.0:1788930245.506177:0:18961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a847aba8-b811-46f0-8caf-0cdd775ee205+7:16939:x1875828747152896:12345-192.168.204.40@tcp:101:mkdir.0 Request processed in 600us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930245.506194:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 14 00010000:00010000:0.0:1788930246.494613:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930247.518616:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788930247.643667:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770214272:0@lo:400:kworker.0 00000100:00100000:3.0:1788930247.643751:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930247.643815:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875828770214784:0@lo:400:kworker.0 00000100:00100000:3.0:1788930247.643843:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930247.643865:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788930247.643871:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c52ce1e4-e465-4485-9875-0a24e445f9ec:3311:1875828770214144:0@lo:400:kworker.0 00000100:00100000:3.0:1788930247.643899:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930247.643922:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770214656:0@lo:400:kworker.0 00000100:00100000:3.0:1788930247.643943:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930247.643968:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770214528:0@lo:400:kworker.0 00000100:00100000:3.0:1788930247.643991:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930247.644008:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788930247.644013:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2eb597c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770214400:0@lo:400:kworker.0 00000100:00100000:3.0:1788930247.644034:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930247.644372:0:20132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770214272 00000100:00100000:3.0:1788930247.644381:0:20132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770214272 00000100:00100000:3.0:1788930247.644435:0:20132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770214400 00000100:00100000:3.0:1788930247.644438:0:20132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770214400 00000100:00100000:3.0:1788930247.644465:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788930247.644490:0:20132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770214272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930247.644549:0:20132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770214272:12345-0@lo:400:kworker.0 Request processed in 61us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930247.644556:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788930247.644573:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788930247.644579:0:20132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770214400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930247.644611:0:20132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770214400:12345-0@lo:400:kworker.0 Request processed in 31us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930247.644616:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788930247.644635:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770214144 00000100:00100000:3.0:1788930247.644638:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770214144 00000100:00100000:3.0:1788930247.644888:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788930247.644896:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:3311:x1875828770214144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930247.644928:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84572050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:3311:x1875828770214144:12345-0@lo:400:kworker.0 Request processed in 33us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930247.644934:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788930247.644961:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770214784 00000100:00100000:3.0:1788930247.644965:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770214784 00000100:00100000:3.0:1788930247.644983:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770214656 00000100:00100000:3.0:1788930247.644986:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770214656 00000100:00100000:3.0:1788930247.644997:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770214528 00000100:00100000:3.0:1788930247.644999:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770214528 00000100:00100000:3.0:1788930247.645011:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788930247.645017:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875828770214784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930247.645189:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770214912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788930247.645281:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875828770214784:12345-0@lo:400:kworker.0 Request processed in 262us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930247.645288:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788930247.645310:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788930247.645316:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770214656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930247.652993:0:18963:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788930247.653023:0:18963:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788930247.653056:0:18961:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788930247.653070:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788930247.653085:0:18961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb597dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770214528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930247.653174:0:18961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770214528:12345-0@lo:400:kworker.0 Request processed in 94us (9182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930247.653181:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788930247.653516:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930247.653547:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770214912 00000100:00100000:2.0:1788930247.653555:0:19648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770214912 00000100:00100000:2.0:1788930247.653590:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788930247.653597:0:19648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770214912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788930247.653625:0:19648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788930247.653664:0:19648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770214912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930247.653671:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788930247.653711:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788930247.653737:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770214912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788930247.653790:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c52ce1e4-e465-4485-9875-0a24e445f9ec:3311:1875828770214144:0@lo:400:kworker.0 00000100:00100000:2.0:1788930247.653806:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770214272:0@lo:400:kworker.0 00000100:00100000:2.0:1788930247.653822:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875828770214784:0@lo:400:kworker.0 00000100:00080000:2.0:1788930247.653863:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788930247.653869:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788930247.653872:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788930247.653910:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770214400:0@lo:400:kworker.0 00000100:00100000:2.0:1788930247.653921:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770214528:0@lo:400:kworker.0 00000100:00100000:2.0:1788930247.665770:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb597f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875828770214656:12345-0@lo:400:kworker.0 Request processed in 20445us (21817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930247.665787:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788930247.665857:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2eb597f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875828770214656:0@lo:400:kworker.0 00000001:00100000:1.0:1788930247.723077:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f6beff19-9e3f-4b9a-94ae-af74e13e7978 00000001:00100000:1.0:1788930247.723093:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a847aba8-b811-46f0-8caf-0cdd775ee205 00000001:00100000:0.0:1788930247.725412:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a847aba8-b811-46f0-8caf-0cdd775ee205 00000001:00100000:0.0:1788930247.725426:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f6beff19-9e3f-4b9a-94ae-af74e13e7978 00000100:00100000:2.0:1788930248.161336:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788930248.161360:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770215040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788930248.161433:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930248.161494:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770215040 00000100:00100000:2.0:1788930248.161502:0:19648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770215040 00000100:00100000:2.0:1788930248.161549:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788930248.161558:0:19648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770215040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788930248.161592:0:19648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1788930248.161652:0:19648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770215040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930248.161659:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788930248.161707:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770215040:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788930248.259756:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a847aba8-b811-46f0-8caf-0cdd775ee205 00000001:02000400:3.0:1788930248.318552:0:20923:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788930248.539873:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930249.567829:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930250.596381:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930250.712640:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930250.712690:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930250.712720:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930250.712749:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930250.712774:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930250.712798:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930250.712825:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930250.712853:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747153536 00000100:00100000:1.0:1788930250.712863:0:18961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747153536 00000100:00100000:1.0:1788930250.712926:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747153152 00000100:00100000:1.0:1788930250.712930:0:18961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747153152 00000100:00100000:1.0:1788930250.712960:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:1.0:1788930250.712972:0:18961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a847aba8-b811-46f0-8caf-0cdd775ee205+6:2361:x1875828747153536:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788930250.713064:0:18961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a847aba8-b811-46f0-8caf-0cdd775ee205+6:2361:x1875828747153536:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 95us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930250.713096:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:1.0:1788930250.713116:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 19 00000100:00100000:1.0:1788930250.713123:0:18961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:2361:x1875828747153152:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788930250.713162:0:18961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:2361:x1875828747153152:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 40us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930250.713169:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 19 00000100:00100000:1.0:1788930250.713191:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747153280 00000100:00100000:1.0:1788930250.713195:0:19647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747153280 00000100:00100000:1.0:1788930250.713215:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747153792 00000100:00100000:1.0:1788930250.713218:0:19647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747153792 00000100:00100000:1.0:1788930250.713342:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747153408 00000100:00100000:1.0:1788930250.713346:0:19647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747153408 00000100:00100000:1.0:1788930250.713360:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747153664 00000100:00100000:1.0:1788930250.713363:0:19647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747153664 00000100:00100000:1.0:1788930250.713377:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:1.0:1788930250.713383:0:19647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+5:2361:x1875828747153280:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788930250.713545:0:19647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+5:2361:x1875828747153280:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 161us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930250.713552:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:1.0:1788930250.713565:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:1.0:1788930250.713571:0:19647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a847aba8-b811-46f0-8caf-0cdd775ee205+5:2361:x1875828747153792:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788930250.713595:0:19647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a847aba8-b811-46f0-8caf-0cdd775ee205+5:2361:x1875828747153792:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 24us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930250.713611:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:1.0:1788930250.713624:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:1.0:1788930250.713629:0:19647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+5:2361:x1875828747153408:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788930250.713651:0:19647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+5:2361:x1875828747153408:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 22us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930250.713656:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:1.0:1788930250.713667:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:1.0:1788930250.713673:0:19647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a847aba8-b811-46f0-8caf-0cdd775ee205+5:2361:x1875828747153664:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788930250.713693:0:19647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a847aba8-b811-46f0-8caf-0cdd775ee205+5:2361:x1875828747153664:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 20us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930250.713699:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00080000:1.0:1788930250.713724:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788930250.713728:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788930250.713731:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788930250.714065:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747153024 00000100:00100000:0.0:1788930250.714070:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747153024 00000100:00100000:0.0:1788930250.714108:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 104 00000100:00100000:0.0:1788930250.714115:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84573050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+13:2361:x1875828747153024:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:0.0:1788930250.714161:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84573050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+13:2361:x1875828747153024:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 47us (1533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930250.714168:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 104 00000020:00000080:3.0:1788930251.613521:0:21071:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4ad05b30 20000000:00000080:3.0:1788930251.613545:0:21071:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d2d8488bc00 uarg=0000000000000000 20000000:01000000:3.0:1788930251.613590:0:21071:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788930251.613597:0:21071:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788930251.613602:0:21071:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00010000:00010000:0.0:1788930251.613829:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788930251.620825:0:21072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1788930251.621092:0:21071:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788930251.633118:0:21071:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788930251.633344:0:21071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d2d86a74600/0xce4472dd2237e4a7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930251.633366:0:21071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ebc597800/0xce4472dd2237e166 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e15f expref: 18 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930251.633373:0:21071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2d86a75a00/0xce4472dd2237e1b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e1ac expref: 18 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930251.633380:0:21071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2ebe0b8200/0xce4472dd2237e303 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e2fc expref: 18 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930251.633412:0:21071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2d86a74400/0xce4472dd2237e445 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210770 expref: 12 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930251.633419:0:21071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d2d86a74c00/0xce4472dd2237e47d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402107d2 expref: 12 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930251.633425:0:21071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d2d86a74600/0xce4472dd2237e4a7 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930251.633472:0:21071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2d86a74c00/0xce4472dd2237e47d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402107d2 expref: 12 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930251.633489:0:21071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2d86a74c00/0xce4472dd2237e47d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402107d2 expref: 12 pid: 18955 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930251.633504:0:21071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21071:1875828770215168:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788930251.633619:0:21071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2d86a74400/0xce4472dd2237e445 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210770 expref: 12 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930251.633629:0:21071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2d86a74400/0xce4472dd2237e445 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210770 expref: 12 pid: 18955 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930251.633637:0:21071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21071:1875828770215296:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788930251.633669:0:21071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ebe0b8200/0xce4472dd2237e303 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237e2fc expref: 18 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930251.633690:0:21071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2ebe0b8200/0xce4472dd2237e303 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237e2fc expref: 18 pid: 18954 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930251.633712:0:21071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21071:1875828770215424:0@lo:104: 00000100:00100000:1.0:1788930251.633753:0:21071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788930251.633788:0:21071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2d86a75a00/0xce4472dd2237e1b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237e1ac expref: 18 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930251.633796:0:21071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2d86a75a00/0xce4472dd2237e1b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237e1ac expref: 18 pid: 18956 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930251.633804:0:21071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21071:1875828770215552:0@lo:104: 00000100:00100000:1.0:1788930251.633824:0:21071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930251.633868:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770215424 00000100:00100000:1.0:1788930251.633875:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770215424 00000100:00100000:1.0:1788930251.633916:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770215552 00000100:00100000:1.0:1788930251.633919:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770215552 00000100:00100000:1.0:1788930251.633932:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788930251.633940:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c52ce1e4-e465-4485-9875-0a24e445f9ec+4:21071:x1875828770215424:12345-0@lo:104: 00010000:00010000:1.0:1788930251.633953:0:18945:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9600/0xce4472dd2237e2fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237e303 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930251.633998:0:18945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788930251.634004:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c52ce1e4-e465-4485-9875-0a24e445f9ec+4:21071:x1875828770215424:12345-0@lo:104: Request processed in 65us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930251.634011:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788930251.634028:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788930251.634034:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c52ce1e4-e465-4485-9875-0a24e445f9ec+3:21071:x1875828770215552:12345-0@lo:104: 00010000:00010000:1.0:1788930251.634042:0:18945:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237e1ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237e1b3 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930251.634088:0:18945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788930251.634093:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c52ce1e4-e465-4485-9875-0a24e445f9ec+3:21071:x1875828770215552:12345-0@lo:104: Request processed in 60us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930251.634099:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788930251.634115:0:18950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788930251.634121:0:18950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9600/0xce4472dd2237e2fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237e303 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930251.634140:0:18950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9600 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:1.0:1788930251.634144:0:18950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9600/0xce4472dd2237e2fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237e303 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930251.634152:0:18950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9600/0xce4472dd2237e2fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237e303 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788930251.634158:0:18950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9600/0xce4472dd2237e2fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237e303 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788930251.634162:0:18950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788930251.634189:0:18950:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9600/0xce4472dd2237e2fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e303 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930251.634195:0:18950:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788930251.634214:0:18950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9600/0xce4472dd2237e2fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e303 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930251.634220:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b9600/0xce4472dd2237e2fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e303 expref: -99 pid: 20363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.635406:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930251.635580:0:21073:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930251.635587:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237e1ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237e1b3 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.635723:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785600 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:0.0:1788930251.635727:0:18949:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237e1ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237e1b3 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.635737:0:18949:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237e1ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237e1b3 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788930251.635744:0:18949:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237e1ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237e1b3 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788930251.635749:0:18949:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788930251.635800:0:18949:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237e1ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e1b3 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.635806:0:18949:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788930251.635818:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237e1ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e1b3 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.635825:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e99785600/0xce4472dd2237e1ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e1b3 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.635840:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930251.635841:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930251.635843:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930251.635847:0:21073:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930251.635849:0:21073:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930251.636185:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930251.636187:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788930251.636188:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788930251.636209:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2d86d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c52ce1e4-e465-4485-9875-0a24e445f9ec:3310:1875828770215680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788930251.636333:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930251.636387:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788930251.636395:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c52ce1e4-e465-4485-9875-0a24e445f9ec:3310:1875828770215808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788930251.636420:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930251.636483:0:18947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770215680 00000100:00100000:0.0:1788930251.636501:0:18947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770215680 00010000:00010000:0.0:1788930251.636537:0:18947:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ebe0b8200/0xce4472dd2237e303 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237e2fc expref: 19 pid: 18954 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930251.636567:0:18947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770215808 00000100:00100000:0.0:1788930251.636570:0:18947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770215808 00010000:00010000:0.0:1788930251.636583:0:18947:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2d86a75a00/0xce4472dd2237e1b3 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237e1ac expref: 20 pid: 18956 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930251.636607:0:18947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788930251.636618:0:18947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c52ce1e4-e465-4485-9875-0a24e445f9ec+20:3310:x1875828770215680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788930251.636633:0:18947:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788930251.636639:0:18947:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ebe0b8200/0xce4472dd2237e303 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237e2fc expref: 20 pid: 18954 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.636660:0:18947:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ebe0b8200/0xce4472dd2237e303 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237e2fc expref: 20 pid: 18954 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930251.636670:0:18946:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1788930251.636679:0:18947:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788930251.636713:0:18947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c52ce1e4-e465-4485-9875-0a24e445f9ec+20:3310:x1875828770215680:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930251.636720:0:18947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788930251.636736:0:18947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788930251.636742:0:18947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:3310:x1875828770215808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788930251.636750:0:18947:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788930251.636755:0:18947:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2d86a75a00/0xce4472dd2237e1b3 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237e1ac expref: 19 pid: 18956 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.636763:0:18947:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2d86a75a00/0xce4472dd2237e1b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237e1ac expref: 19 pid: 18956 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.636771:0:18947:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788930251.636960:0:18946:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788930251.637015:0:18947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:3310:x1875828770215808:12345-0@lo:103:ldlm_bl.0 Request processed in 271us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930251.637023:0:18947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788930251.637422:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c52ce1e4-e465-4485-9875-0a24e445f9ec:3310:1875828770215808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788930251.637433:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c52ce1e4-e465-4485-9875-0a24e445f9ec:3310:1875828770215680:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788930251.637484:0:21071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d2ebc597800/0xce4472dd2237e166 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xce4472dd2237e15f expref: 18 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930251.637497:0:21071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d2ebc597800/0xce4472dd2237e166 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xce4472dd2237e15f expref: 18 pid: 18954 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930251.637509:0:21071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21071:1875828770215936:0@lo:104: 00000100:00100000:1.0:1788930251.637550:0:21071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930251.637568:0:21071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e8b7246c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788930251.637580:0:21071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebe0b8200/0xce4472dd2237e303 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237e2fc expref: 18 pid: 18954 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930251.637591:0:21071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21071:1875828770215424:0@lo:104: 00010000:00010000:1.0:1788930251.637600:0:21071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d86a75a00/0xce4472dd2237e1b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237e1ac expref: 17 pid: 18956 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930251.637623:0:21071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21071:1875828770215552:0@lo:104: 00000100:00100000:2.0:1788930251.638944:0:18945:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788930251.638966:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770215936 00000100:00100000:2.0:1788930251.638974:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770215936 00000100:00100000:2.0:1788930251.639041:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788930251.639050:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86741850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c52ce1e4-e465-4485-9875-0a24e445f9ec+3:21071:x1875828770215936:12345-0@lo:104: 00010000:00010000:2.0:1788930251.639065:0:18945:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237e15f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237e166 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930251.639152:0:18945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788930251.639158:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86741850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c52ce1e4-e465-4485-9875-0a24e445f9ec+3:21071:x1875828770215936:12345-0@lo:104: Request processed in 111us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930251.639165:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788930251.639202:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930251.639211:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237e15f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xce4472dd2237e166 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.639220:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2e99785800 already unused, calling callback (ffffffffc1d26c20) 10000000:00010000:0.0:1788930251.639241:0:18949:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237e15f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xce4472dd2237e166 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.639264:0:18949:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237e15f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xce4472dd2237e166 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788930251.639272:0:18949:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237e15f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xce4472dd2237e166 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788930251.639278:0:18949:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788930251.639314:0:18949:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237e15f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e166 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.639323:0:18949:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788930251.639345:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237e15f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e166 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930251.639353:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c52ce1e4-e465-4485-9875-0a24e445f9ec:3308:1875828770216064:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788930251.639355:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.140@tcp lock: ffff8d2e99785800/0xce4472dd2237e15f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xce4472dd2237e166 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.639378:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930251.639381:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930251.639383:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788930251.639398:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930251.639416:0:18947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770216064 00000100:00100000:0.0:1788930251.639421:0:18947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770216064 00010000:00010000:0.0:1788930251.639446:0:18947:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2ebc597800/0xce4472dd2237e166 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237e15f expref: 17 pid: 18954 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930251.639478:0:18947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788930251.639485:0:18947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86daa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c52ce1e4-e465-4485-9875-0a24e445f9ec+17:3308:x1875828770216064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788930251.639497:0:18947:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788930251.639502:0:18947:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2ebc597800/0xce4472dd2237e166 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xce4472dd2237e15f expref: 17 pid: 18954 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.639517:0:18947:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2ebc597800/0xce4472dd2237e166 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xce4472dd2237e15f expref: 17 pid: 18954 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.639535:0:18947:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788930251.639573:0:18947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86daa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c52ce1e4-e465-4485-9875-0a24e445f9ec+17:3308:x1875828770216064:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930251.639581:0:18947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788930251.639650:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c52ce1e4-e465-4485-9875-0a24e445f9ec:3308:1875828770216064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788930251.640414:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930251.640487:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930251.640645:0:21071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21071:1875828770215168:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788930251.640657:0:21071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2d86d8f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21071:1875828770215296:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788930251.640669:0:21071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2ebc597800/0xce4472dd2237e166 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xce4472dd2237e15f expref: 16 pid: 18954 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930251.640693:0:21071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21071:1875828770215936:0@lo:104: 00010000:00010000:1.0:1788930251.640723:0:21071:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d2d86a74600/0xce4472dd2237e4a7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930251.640867:0:21074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747153920 00000100:00100000:3.0:1788930251.640873:0:21074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747153920 00010000:00010000:3.0:1788930251.640899:0:21074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2d86a74c00/0xce4472dd2237e47d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402107d2 expref: 13 pid: 18955 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930251.640928:0:21074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747154048 00000100:00100000:3.0:1788930251.640932:0:21074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747154048 00010000:00010000:3.0:1788930251.640946:0:21074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d2d86a74400/0xce4472dd2237e445 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210770 expref: 14 pid: 18955 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930251.640978:0:21074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:0.0:1788930251.640987:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:3.0:1788930251.640989:0:21074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54fa4f43-feb8-4641-8502-e0f8083e1215+14:2362:x1875828747153920:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788930251.641003:0:21074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788930251.641009:0:18946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54fa4f43-feb8-4641-8502-e0f8083e1215+14:2362:x1875828747154048:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788930251.641012:0:21074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2d86a74c00/0xce4472dd2237e47d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402107d2 expref: 14 pid: 18955 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.641022:0:18946:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788930251.641027:0:21074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2d86a74c00/0xce4472dd2237e47d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402107d2 expref: 14 pid: 18955 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.641031:0:18946:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d2d86a74400/0xce4472dd2237e445 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210770 expref: 14 pid: 18955 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.641058:0:18946:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d2d86a74400/0xce4472dd2237e445 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210770 expref: 14 pid: 18955 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.641072:0:18946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d86a74400/0xce4472dd2237e445 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210770 expref: 14 pid: 18955 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.641085:0:18946:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d2d86a74600/0xce4472dd2237e4a7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930251.641093:0:21074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d86a74c00/0xce4472dd2237e47d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402107d2 expref: 14 pid: 18955 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.641096:0:18946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d86a74600/0xce4472dd2237e4a7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.641112:0:18946:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2d86a74600/0xce4472dd2237e4a7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930251.641118:0:21074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788930251.641143:0:18946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d2d86a74600/0xce4472dd2237e4a7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.641151:0:18946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d2d86a74600/0xce4472dd2237e4a7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.641160:0:18946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d2d86a74600/0xce4472dd2237e4a7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.641166:0:18946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74600 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930251.641171:0:18946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d2d86a74600/0xce4472dd2237e4a7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.641180:0:18946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d2d86a74600/0xce4472dd2237e4a7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930251.641185:0:21074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54fa4f43-feb8-4641-8502-e0f8083e1215+12:2362:x1875828747153920:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 197us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930251.641197:0:21074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 7 00010000:00010000:0.0:1788930251.641199:0:18946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d2d86a74600/0xce4472dd2237e4a7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930251.641212:0:18946:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788930251.641268:0:18946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54fa4f43-feb8-4641-8502-e0f8083e1215+11:2362:x1875828747154048:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 266us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930251.641286:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 8 00010000:00010000:1.0:1788930251.641486:0:21071:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d2d86a74600/0xce4472dd2237e4a7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930251.641494:0:21071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d2d86a74600/0xce4472dd2237e4a7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930251.641501:0:21071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d2d86a74600/0xce4472dd2237e4a7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930252.635447:0:21073:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930252.763528:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770216192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788930252.763612:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930252.763665:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770216192 00000100:00100000:1.0:1788930252.763676:0:19648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770216192 00000100:00100000:1.0:1788930252.763745:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788930252.763755:0:19648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88160380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770216192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788930252.763792:0:19648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788930252.763843:0:19648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88160380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770216192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930252.763852:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788930252.763918:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788930252.764148:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770216192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788930252.764166:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788930252.764216:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c52ce1e4-e465-4485-9875-0a24e445f9ec:3310:1875828770216320:0@lo:400:kworker.0 00000100:00100000:2.0:1788930252.764243:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770216448:0@lo:400:kworker.0 00000100:00100000:1.0:1788930252.764277:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930252.764290:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930252.764330:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770216320 00000100:00100000:1.0:1788930252.764335:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770216320 00000100:00100000:2.0:1788930252.764354:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770216448 00000100:00100000:2.0:1788930252.764359:0:19647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770216448 00000100:00100000:1.0:1788930252.764369:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788930252.764378:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84570450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:3310:x1875828770216320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930252.764415:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788930252.764424:0:19647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770216448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930252.764434:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84570450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:3310:x1875828770216320:12345-0@lo:400:kworker.0 Request processed in 57us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930252.764441:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788930252.764467:0:19647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770216448:12345-0@lo:400:kworker.0 Request processed in 45us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930252.764474:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788930252.764490:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788930252.764507:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770216448:0@lo:400:kworker.0 00000100:00100000:0.0:1788930252.764937:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770216576:0@lo:400:kworker.0 00000100:00100000:3.0:1788930252.764964:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788930252.764975:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875828770216832:0@lo:400:kworker.0 00000100:00100000:0.0:1788930252.764995:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930252.765030:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930252.765039:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875828770216704:0@lo:400:kworker.0 00000100:00100000:3.0:1788930252.765066:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770216576 00000100:00100000:0.0:1788930252.765071:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930252.765073:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770216576 00000100:00100000:0.0:1788930252.765121:0:20889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770216832 00000100:00100000:0.0:1788930252.765127:0:20889:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770216832 00000100:00100000:3.0:1788930252.765133:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770216704 00000100:00100000:3.0:1788930252.765139:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770216704 00000100:00100000:0.0:1788930252.765167:0:20889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788930252.765178:0:20889:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770216576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930252.765184:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788930252.765193:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875828770216832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930252.765248:0:20889:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875828770216576:12345-0@lo:400:kworker.0 Request processed in 72us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930252.765256:0:20889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788930252.765267:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875828770216832:12345-0@lo:400:kworker.0 Request processed in 74us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930252.765284:0:20889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788930252.765293:0:20889:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875828770216704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788930252.765325:0:20889:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875828770216704:12345-0@lo:400:kworker.0 Request processed in 33us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930252.765506:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c52ce1e4-e465-4485-9875-0a24e445f9ec:3310:1875828770216320:0@lo:400:kworker.0 00000100:00080000:1.0:1788930252.765535:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788930252.765554:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875828770216704:0@lo:400:kworker.0 00000100:00100000:1.0:1788930252.765564:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875828770216576:0@lo:400:kworker.0 00000100:00100000:1.0:1788930252.765598:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875828770216832:0@lo:400:kworker.0 00000100:00100000:3.0:1788930252.767051:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788930252.767159:0:20889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788930252.822686:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930252.823321:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747154176 00000100:00100000:1.0:1788930252.823334:0:18961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747154176 00000100:00080000:2.0:1788930252.823607:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788930252.823621:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 15 00000100:00100000:1.0:1788930252.823636:0:18961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:17404:x1875828747154176:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788930252.823659:0:18961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930252.823685:0:18961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74600/0xce4472dd2237e4ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210803 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.823756:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e4b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.823771:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.823818:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.823836:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237e4bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.823843:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237e4bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.823850:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237e4bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.824208:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237e4c3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.824218:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237e4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.824251:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237e4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788930252.824276:0:18961:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788930252.824279:0:18961:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788930252.824312:0:18961:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237e4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.824323:0:18961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.824330:0:18961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e4b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.824347:0:18961:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e4b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.824353:0:18961:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a75a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930252.824368:0:18961:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e4b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.824377:0:18961:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e4b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.824389:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4a00) 00010000:00010000:1.0:1788930252.824392:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788930252.824397:0:18961:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e4b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.824404:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e4b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.824418:0:18961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237e4bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.824424:0:18961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237e4bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.824430:0:18961:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237e4bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.824434:0:18961:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930252.824437:0:18961:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237e4bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.824453:0:18961:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237e4bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.824462:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d2e8528d100) 00010000:00010000:1.0:1788930252.824464:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788930252.824466:0:18961:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237e4bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.824471:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237e4bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.826682:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74600/0xce4472dd2237e4ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210803 expref: 8 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.826717:0:18961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75800/0xce4472dd2237e4c3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210803 expref: 7 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.826726:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2e8528db00) 00010000:00010000:1.0:1788930252.826729:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788930252.826732:0:18961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a75800, rc 0) 00000100:00100000:1.0:1788930252.826827:0:18961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+7:17404:x1875828747154176:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 3194us (4153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930252.831313:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 15 00000100:00100000:1.0:1788930252.837099:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930252.837276:0:20889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747154432 00000100:00100000:0.0:1788930252.837288:0:20889:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747154432 00000100:00100000:0.0:1788930252.837399:0:20889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 16 00000100:00100000:0.0:1788930252.837410:0:20889:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+7:17404:x1875828747154432:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788930252.837429:0:20889:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930252.837448:0:20889:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8a00/0xce4472dd2237e4ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021080a expref: -99 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.837519:0:20889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237e4d1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.837533:0:20889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237e4d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.837556:0:20889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237e4d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.837573:0:20889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e4d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.837580:0:20889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.837587:0:20889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.837904:0:20889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237e4df lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.837913:0:20889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237e4df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.837920:0:20889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237e4df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788930252.837930:0:20889:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788930252.838090:0:20889:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237e4d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.838098:0:20889:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237e4d1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.838118:0:20889:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237e4d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.838124:0:20889:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b9c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788930252.838134:0:20889:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237e4d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.838142:0:20889:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237e4d1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.838153:0:20889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d2e8528db00) 00010000:00010000:0.0:1788930252.838157:0:20889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788930252.838161:0:20889:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237e4d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.838168:0:20889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9c00/0xce4472dd2237e4d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.838180:0:20889:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.838186:0:20889:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e4d8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.838193:0:20889:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.838198:0:20889:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788930252.838201:0:20889:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.838206:0:20889:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e4d8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.838212:0:20889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d2e907e4200) 00010000:00010000:0.0:1788930252.838215:0:20889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788930252.838923:0:20889:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e4d8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.839063:0:20889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e4d8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.839724:0:20889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8a00/0xce4472dd2237e4ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021080a expref: 10 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.839752:0:20889:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9600/0xce4472dd2237e4df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021080a expref: 9 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.839761:0:20889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2e907e4100) 00010000:00010000:0.0:1788930252.839764:0:20889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788930252.839767:0:20889:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9600, rc 0) 00000100:00100000:0.0:1788930252.839851:0:20889:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+9:17404:x1875828747154432:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 2442us (2763us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788930252.839859:0:20889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 16 00000100:00100000:2.0:1788930252.847733:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930252.848470:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747154560 00000100:00100000:3.0:1788930252.848484:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747154560 00000100:00100000:3.0:1788930252.848564:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 17 00000100:00100000:3.0:1788930252.848575:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+9:17404:x1875828747154560:12345-192.168.204.40@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788930252.848701:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+9:17404:x1875828747154560:12345-192.168.204.40@tcp:59:lhsmtool_posix.0 Request processed in 126us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930252.848709:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 17 00000100:00100000:2.0:1788930252.886639:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930252.886747:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747154688 00000100:00100000:3.0:1788930252.886761:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747154688 00000100:00100000:3.0:1788930252.886942:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:3.0:1788930252.886973:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+9:17410:x1875828747154688:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1788930252.886997:0:18963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930252.887023:0:18963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237e4ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210811 expref: -99 pid: 18963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887113:0:18963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596600/0xce4472dd2237e4f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887130:0:18963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596600/0xce4472dd2237e4f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887147:0:18963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596600/0xce4472dd2237e4f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887162:0:18963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e4fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887187:0:18963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e4fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887195:0:18963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e4fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887432:0:18963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596600/0xce4472dd2237e4f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887441:0:18963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596600/0xce4472dd2237e4f4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887449:0:18963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596600/0xce4472dd2237e4f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887464:0:18963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788930252.887469:0:18963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596600/0xce4472dd2237e4f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887478:0:18963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596600/0xce4472dd2237e4f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887492:0:18963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4a00) 00010000:00010000:3.0:1788930252.887495:0:18963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788930252.887501:0:18963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596600/0xce4472dd2237e4f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887507:0:18963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596600/0xce4472dd2237e4f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887520:0:18963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e4fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887526:0:18963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e4fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887532:0:18963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e4fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887537:0:18963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788930252.887540:0:18963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e4fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887545:0:18963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e4fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887562:0:18963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d2e838fb000) 00010000:00010000:3.0:1788930252.887565:0:18963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788930252.887568:0:18963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e4fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887573:0:18963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e4fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887607:0:18963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237e4ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210811 expref: 10 pid: 18963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887618:0:18963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4a00) 00010000:00010000:3.0:1788930252.887620:0:18963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788930252.887623:0:18963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237e4ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210811 expref: 10 pid: 18963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.887632:0:18963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596a00, rc 0) 00000100:00100000:3.0:1788930252.887965:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+9:17410:x1875828747154688:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 994us (1339us total) trans 0 rc 301/301 00000100:00100000:3.0:1788930252.887975:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:0.0:1788930252.888967:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930252.889144:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747154816 00000100:00100000:1.0:1788930252.889157:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747154816 00000100:00100000:1.0:1788930252.889246:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 106 00000100:00100000:1.0:1788930252.889256:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+11:16798:x1875828747154816:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788930252.889284:0:18955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930252.889305:0:18955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d86a74600/0xce4472dd2237e502 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca71640210818 expref: -99 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.889333:0:18955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d86a74600/0xce4472dd2237e502 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210818 expref: 12 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.889345:0:18955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d86a74600/0xce4472dd2237e502 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210818 expref: 12 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930252.889354:0:18955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a74600, rc 0) 00000100:00100000:1.0:1788930252.889401:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84571850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+12:16798:x1875828747154816:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 146us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930252.889408:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 106 00000100:00100000:2.0:1788930252.896273:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930252.896605:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747154944 00000100:00100000:1.0:1788930252.896619:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747154944 00000100:00100000:1.0:1788930252.896733:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 107 00000100:00100000:1.0:1788930252.896745:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+12:16798:x1875828747154944:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788930252.897161:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84570850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+12:16798:x1875828747154944:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 418us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930252.897170:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 107 00000100:00100000:3.0:1788930252.903009:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930252.903196:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930252.903437:0:18970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747155200 00000100:00100000:1.0:1788930252.903450:0:18970:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747155200 00000100:00100000:1.0:1788930252.903517:0:18970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:1.0:1788930252.903529:0:18970:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+9:17410:x1875828747155200:12345-192.168.204.40@tcp:700:lfs.0 00000100:00100000:1.0:1788930252.903634:0:18970:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+9:17410:x1875828747155200:12345-192.168.204.40@tcp:700:lfs.0 Request processed in 106us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930252.903658:0:18970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:1.0:1788930252.906301:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930252.906497:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747155456 00000100:00100000:3.0:1788930252.906510:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747155456 00000100:00100000:3.0:1788930252.906586:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 19 00000100:00100000:3.0:1788930252.906596:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+9:17410:x1875828747155456:12345-192.168.204.40@tcp:36:lfs.0 00010000:00010000:3.0:1788930252.906662:0:18962:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788930252.906711:0:18962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237e468 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021079a expref: 9 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.906732:0:18962:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4a00) 00010000:00010000:3.0:1788930252.906737:0:18962:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788930252.907083:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237e509 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.907111:0:18962:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f000/0xce4472dd2237e4a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402107fc expref: 5 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.907120:0:18962:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237e509 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.907160:0:18962:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f000/0xce4472dd2237e4a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402107fc expref: 5 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.907176:0:18962:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f000/0xce4472dd2237e4a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402107fc expref: 5 pid: 18961 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930252.907563:0:18962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90315c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18962:1875828770216960:192.168.204.40@tcp:104: 00000100:00100000:3.0:1788930252.907685:0:18962:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2eb5b07cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788930252.907828:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747155072 00000100:00100000:0.0:1788930252.907837:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747155072 00000100:00100000:0.0:1788930252.907886:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 108 00000100:00100000:0.0:1788930252.907895:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+12:16798:x1875828747155072:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788930252.908111:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84570050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54fa4f43-feb8-4641-8502-e0f8083e1215+12:16798:x1875828747155072:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 205us (5103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930252.908120:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 108 00000100:00100000:0.0:1788930252.911956:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930252.912091:0:18947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747155584 00000100:00100000:2.0:1788930252.912113:0:18947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747155584 00000100:00100000:3.0:1788930252.912168:0:18962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90315c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18962:1875828770216960:192.168.204.40@tcp:104: 00010000:00010000:2.0:1788930252.912187:0:18947:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f000/0xce4472dd2237e4a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402107fc expref: 6 pid: 18961 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.912243:0:18962:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237e509 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930252.912247:0:18947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:2.0:1788930252.912261:0:18947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88162300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a847aba8-b811-46f0-8caf-0cdd775ee205+6:2362:x1875828747155584:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788930252.912277:0:18947:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788930252.912285:0:18947:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f000/0xce4472dd2237e4a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402107fc expref: 6 pid: 18961 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930252.912299:0:18947:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f000/0xce4472dd2237e4a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402107fc expref: 6 pid: 18961 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930252.912324:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f000/0xce4472dd2237e4a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402107fc expref: 6 pid: 18961 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930252.912341:0:18947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4a00) 00010000:00010000:2.0:1788930252.912351:0:18947:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237e509 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930252.912362:0:18947:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237e509 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930252.912370:0:18947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237e509 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930252.912421:0:18947:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788930252.912485:0:18947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88162300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a847aba8-b811-46f0-8caf-0cdd775ee205+5:2362:x1875828747155584:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 227us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930252.912494:0:18947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 9 00010000:00010000:3.0:1788930252.913155:0:18962:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237e509 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.913178:0:18962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237e509 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.913221:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e510 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.913262:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e510 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930252.913272:0:18962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e510 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788930252.914883:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1788930252.917835:0:18962:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788930252.917876:0:18962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237e509 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930252.917891:0:18962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237e509 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930252.917901:0:18962:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237e509 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930252.917908:0:18962:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930252.917913:0:18962:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237e509 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930252.917922:0:18962:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237e509 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930252.917954:0:18962:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4a00) 00010000:00010000:2.0:1788930252.917958:0:18962:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930252.918374:0:18962:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237e509 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930252.918385:0:18962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596a00/0xce4472dd2237e509 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788930252.918418:0:18962:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000624726c9 reply state 0000000095949f81 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e510 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930252.918440:0:18962:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788930252.919087:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+10:17410:x1875828747155456:12345-192.168.204.40@tcp:36:lfs.0 Request processed in 12485us (12792us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788930252.919109:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 19 00010000:00010000:0.0:1788930252.923780:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e510 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.923807:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e510 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.923816:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e510 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.923822:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788930252.923827:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e510 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.924060:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e510 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.924088:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d2e838fb000) 00010000:00010000:0.0:1788930252.924092:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788930252.924110:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e510 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.924118:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e510 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930252.927497:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930252.927826:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747155712 00000100:00100000:2.0:1788930252.927838:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747155712 00000100:00100000:2.0:1788930252.927898:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 109 00000100:00100000:2.0:1788930252.927909:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84573c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+12:16798:x1875828747155712:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788930252.927931:0:18956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930252.927951:0:18956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d8566f000/0xce4472dd2237e517 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa85ca7164021081f expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930252.929066:0:18956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d8566f000/0xce4472dd2237e517 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021081f expref: 13 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930252.929086:0:18956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d8566f000/0xce4472dd2237e517 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021081f expref: 13 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930252.929096:0:18956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8566f000, rc 0) 00000100:00100000:2.0:1788930252.929177:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84573c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+13:16798:x1875828747155712:12345-192.168.204.40@tcp:101:ll_cfg_requeue.0 Request processed in 1269us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930252.929186:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 109 00000100:00100000:2.0:1788930252.932110:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930252.932322:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747155840 00000100:00100000:0.0:1788930252.932334:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747155840 00000100:00100000:0.0:1788930252.932438:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 110 00000100:00100000:0.0:1788930252.932450:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+13:16798:x1875828747155840:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788930252.932786:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84573850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+13:16798:x1875828747155840:12345-192.168.204.40@tcp:501:ll_cfg_requeue.0 Request processed in 337us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930252.932794:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 110 00000100:00100000:0.0:1788930252.936430:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930252.936544:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747155968 00000100:00100000:2.0:1788930252.936557:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747155968 00000100:00100000:2.0:1788930252.936620:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 111 00000100:00100000:2.0:1788930252.936631:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+13:16798:x1875828747155968:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788930252.936965:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84572850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54fa4f43-feb8-4641-8502-e0f8083e1215+13:16798:x1875828747155968:12345-192.168.204.40@tcp:503:ll_cfg_requeue.0 Request processed in 334us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930252.936973:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 111 00000100:00100000:1.0:1788930252.972641:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930252.975068:0:20889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747156096 00000100:00100000:0.0:1788930252.975096:0:20889:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747156096 00000100:00100000:0.0:1788930252.975207:0:20889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 20 00000100:00100000:0.0:1788930252.975219:0:20889:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+9:17420:x1875828747156096:12345-192.168.204.40@tcp:101:lctl.0 00010000:00010000:0.0:1788930252.975265:0:20889:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930252.975297:0:20889:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237e51e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210826 expref: -99 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.975367:0:20889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237e525 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.975382:0:20889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237e525 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.975392:0:20889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237e525 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788930252.975429:0:20889:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788930252.975433:0:20889:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788930252.975485:0:20889:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237e525 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.975511:0:20889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237e51e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210826 expref: 11 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.975531:0:20889:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b9200/0xce4472dd2237e525 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210826 expref: 10 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930252.975539:0:20889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4200) 00010000:00010000:0.0:1788930252.975568:0:20889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788930252.975573:0:20889:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b9200, rc 0) 00000100:00100000:0.0:1788930252.975656:0:20889:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+10:17420:x1875828747156096:12345-192.168.204.40@tcp:101:lctl.0 Request processed in 439us (3025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930252.975664:0:20889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 20 00000100:00100000:3.0:1788930253.002532:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930253.002641:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747156224 00000100:00100000:1.0:1788930253.002652:0:18961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747156224 00000100:00100000:1.0:1788930253.002725:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 21 00000100:00100000:1.0:1788930253.002736:0:18961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a847aba8-b811-46f0-8caf-0cdd775ee205+5:17421:x1875828747156224:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1788930253.002769:0:18961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930253.002790:0:18961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e52c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021082d expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.002857:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237e533 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.002872:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237e533 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.002885:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237e533 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788930253.002931:0:18961:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788930253.002936:0:18961:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788930253.002956:0:18961:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237e533 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.002980:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e52c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021082d expref: 7 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.003026:0:18961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74000/0xce4472dd2237e533 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021082d expref: 6 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.003035:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4200) 00010000:00010000:1.0:1788930253.003038:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788930253.003042:0:18961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a74000, rc 0) 00000100:00100000:1.0:1788930253.003290:0:18961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a847aba8-b811-46f0-8caf-0cdd775ee205+6:17421:x1875828747156224:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 489us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930253.003297:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 21 00000100:00100000:1.0:1788930253.007640:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930253.007726:0:20889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747156352 00000100:00100000:0.0:1788930253.007737:0:20889:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747156352 00000100:00100000:0.0:1788930253.007797:0:20889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 22 00000100:00100000:0.0:1788930253.007807:0:20889:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a847aba8-b811-46f0-8caf-0cdd775ee205+6:17421:x1875828747156352:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788930253.007829:0:20889:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930253.007848:0:20889:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237e53a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210834 expref: -99 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.007908:0:20889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e541 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.007922:0:20889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e541 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.007934:0:20889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e541 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.007959:0:20889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e548 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.007967:0:20889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e548 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.007973:0:20889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e548 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.008078:0:20889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237e54f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.008086:0:20889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237e54f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.008093:0:20889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237e54f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788930253.008139:0:20889:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788930253.008144:0:20889:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788930253.008166:0:20889:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237e54f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.008178:0:20889:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e541 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.008185:0:20889:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e541 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.008192:0:20889:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e541 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.008198:0:20889:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788930253.008202:0:20889:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e541 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.008209:0:20889:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e541 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.008219:0:20889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4200) 00010000:00010000:0.0:1788930253.008279:0:20889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788930253.008286:0:20889:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e541 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.008293:0:20889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e541 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.008307:0:20889:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e548 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.008312:0:20889:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e548 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.008317:0:20889:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e548 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.008321:0:20889:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788930253.008324:0:20889:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e548 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.008330:0:20889:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e548 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.008337:0:20889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d2e907e4700) 00010000:00010000:0.0:1788930253.008339:0:20889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788930253.008342:0:20889:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e548 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.008348:0:20889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e548 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.008380:0:20889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237e53a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210834 expref: 8 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.008407:0:20889:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237e54f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210834 expref: 7 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.008414:0:20889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2e907e4f00) 00010000:00010000:0.0:1788930253.008417:0:20889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788930253.008419:0:20889:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8600, rc 0) 00000100:00100000:0.0:1788930253.008475:0:20889:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a847aba8-b811-46f0-8caf-0cdd775ee205+7:17421:x1875828747156352:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 669us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930253.008483:0:20889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 22 00000100:00100000:2.0:1788930253.012845:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930253.013219:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747156608 00000100:00100000:1.0:1788930253.013261:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747156608 00000100:00100000:1.0:1788930253.013318:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 23 00000100:00100000:1.0:1788930253.013328:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a847aba8-b811-46f0-8caf-0cdd775ee205+7:17421:x1875828747156608:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1788930253.013348:0:18962:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930253.013365:0:18962:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e556 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021083b expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788930253.013454:0:18962:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788930253.013573:0:18962:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e556 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021083b expref: 9 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.013587:0:18962:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4200) 00010000:00010000:1.0:1788930253.013590:0:18962:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788930253.013595:0:18962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e556 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021083b expref: 9 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.013623:0:18962:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a75a00, rc 0) 00000100:00100000:1.0:1788930253.013683:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a847aba8-b811-46f0-8caf-0cdd775ee205+8:17421:x1875828747156608:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 355us (848us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1788930253.013690:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 23 00000100:00100000:2.0:1788930253.017679:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930253.017770:0:20889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747156864 00000100:00100000:0.0:1788930253.017782:0:20889:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747156864 00000100:00100000:0.0:1788930253.017843:0:20889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 24 00000100:00100000:0.0:1788930253.017854:0:20889:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a847aba8-b811-46f0-8caf-0cdd775ee205+8:17421:x1875828747156864:12345-192.168.204.40@tcp:36:lfs.0 00010000:00010000:0.0:1788930253.017906:0:20889:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788930253.017932:0:20889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237e54f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210834 expref: 8 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.017950:0:20889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2e907e4f00) 00010000:00010000:0.0:1788930253.017961:0:20889:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788930253.017982:0:20889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237e564 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.017996:0:20889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237e564 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.018005:0:20889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237e564 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788930253.018306:0:20889:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006066f292 reply state 0000000024cbcd5b transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237e564 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930253.018316:0:20889:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788930253.018323:0:20889:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788930253.018401:0:20889:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a847aba8-b811-46f0-8caf-0cdd775ee205+9:17421:x1875828747156864:12345-192.168.204.40@tcp:36:lfs.0 Request processed in 549us (732us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788930253.018408:0:20889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 24 00010000:00010000:0.0:1788930253.021160:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237e564 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.021179:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237e564 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.021187:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237e564 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.021193:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788930253.021197:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237e564 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.021205:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237e564 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.021220:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2e907e4700) 00010000:00010000:0.0:1788930253.021253:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788930253.021259:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237e564 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.021265:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237e564 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930253.022218:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930253.022389:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747157120 00000100:00100000:1.0:1788930253.022399:0:18965:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747157120 00000100:00100000:1.0:1788930253.022447:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:1.0:1788930253.022457:0:18965:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a847aba8-b811-46f0-8caf-0cdd775ee205+8:17421:x1875828747157120:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:1.0:1788930253.023008:0:18965:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a847aba8-b811-46f0-8caf-0cdd775ee205+9:17421:x1875828747157120:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 550us (792us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788930253.023016:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:3.0:1788930253.025430:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930253.025557:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747157376 00000100:00100000:1.0:1788930253.025565:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747157376 00000100:00100000:1.0:1788930253.025620:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 25 00000100:00100000:1.0:1788930253.025629:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a847aba8-b811-46f0-8caf-0cdd775ee205+9:17421:x1875828747157376:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1788930253.025651:0:18962:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930253.025669:0:18962:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e56b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210842 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.025735:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e572 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.025750:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e572 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.025761:0:18962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e572 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.025790:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e579 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.025797:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e579 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.025805:0:18962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e579 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788930253.025908:0:18962:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788930253.025988:0:18962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e572 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.025996:0:18962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e572 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.026002:0:18962:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e572 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.026008:0:18962:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930253.026012:0:18962:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e572 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.026020:0:18962:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e572 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.026030:0:18962:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4200) 00010000:00010000:1.0:1788930253.026033:0:18962:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788930253.026038:0:18962:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e572 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.026053:0:18962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e572 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.026065:0:18962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e579 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.026070:0:18962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e579 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.026075:0:18962:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e579 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.026079:0:18962:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930253.026082:0:18962:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e579 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.026087:0:18962:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e579 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.026094:0:18962:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d2e8528de00) 00010000:00010000:1.0:1788930253.026111:0:18962:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788930253.026115:0:18962:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e579 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.026121:0:18962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e579 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.026155:0:18962:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e56b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210842 expref: 11 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.026174:0:18962:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4200) 00010000:00010000:1.0:1788930253.026176:0:18962:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788930253.026180:0:18962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e56b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210842 expref: 11 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.026189:0:18962:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a75a00, rc 0) 00000100:00100000:1.0:1788930253.026273:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a847aba8-b811-46f0-8caf-0cdd775ee205+10:17421:x1875828747157376:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 645us (852us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1788930253.026280:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 25 00000100:00100000:2.0:1788930253.029495:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930253.030285:0:20889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747157504 00000100:00100000:0.0:1788930253.030295:0:20889:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747157504 00000100:00100000:0.0:1788930253.030356:0:20889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 26 00000100:00100000:0.0:1788930253.030366:0:20889:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a847aba8-b811-46f0-8caf-0cdd775ee205+10:17421:x1875828747157504:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:0.0:1788930253.030389:0:20889:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930253.030409:0:20889:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237e587 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210849 expref: -99 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.030512:0:20889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e58e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.030529:0:20889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e58e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.030543:0:20889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e58e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788930253.030571:0:20889:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788930253.030574:0:20889:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788930253.030594:0:20889:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e58e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.030620:0:20889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8600/0xce4472dd2237e587 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210849 expref: 12 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.030639:0:20889:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e58e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210849 expref: 11 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.030647:0:20889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2e907e4f00) 00010000:00010000:0.0:1788930253.030664:0:20889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788930253.030668:0:20889:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebe0b8200, rc 0) 00000100:00100000:0.0:1788930253.030735:0:20889:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a847aba8-b811-46f0-8caf-0cdd775ee205+11:17421:x1875828747157504:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 371us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930253.030743:0:20889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 26 00000100:00100000:2.0:1788930253.039313:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930253.039397:0:18964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747157632 00000100:00100000:0.0:1788930253.039408:0:18964:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747157632 00000100:00100000:0.0:1788930253.039502:0:18964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:0.0:1788930253.039512:0:18964:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a847aba8-b811-46f0-8caf-0cdd775ee205+11:17421:x1875828747157632:12345-192.168.204.40@tcp:37:lfs.0 00000100:00100000:0.0:1788930253.044852:0:18964:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a847aba8-b811-46f0-8caf-0cdd775ee205+11:17421:x1875828747157632:12345-192.168.204.40@tcp:37:lfs.0 Request processed in 5330us (5538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930253.044866:0:18964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:0.0:1788930253.049370:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930253.049452:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747157888 00000100:00100000:1.0:1788930253.049462:0:18965:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747157888 00000100:00100000:1.0:1788930253.049512:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:1.0:1788930253.049524:0:18965:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86315c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a847aba8-b811-46f0-8caf-0cdd775ee205+11:17421:x1875828747157888:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:1.0:1788930253.049748:0:18965:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86315c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a847aba8-b811-46f0-8caf-0cdd775ee205+12:17421:x1875828747157888:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 225us (387us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788930253.049756:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:2.0:1788930253.101640:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930253.101773:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747158016 00000100:00100000:1.0:1788930253.101783:0:18961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747158016 00000100:00100000:1.0:1788930253.101850:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 27 00000100:00100000:1.0:1788930253.101862:0:18961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+10:17427:x1875828747158016:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:1.0:1788930253.101883:0:18961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930253.101903:0:18961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e595 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210850 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.101979:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e59c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102006:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e59c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102019:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e59c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102034:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102040:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102046:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102153:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75600/0xce4472dd2237e5aa lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102162:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75600/0xce4472dd2237e5aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102169:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75600/0xce4472dd2237e5aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788930253.102195:0:18961:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788930253.102198:0:18961:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788930253.102374:0:18961:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75600/0xce4472dd2237e5aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102389:0:18961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e59c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102406:0:18961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e59c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102413:0:18961:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e59c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102419:0:18961:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930253.102423:0:18961:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e59c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102431:0:18961:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e59c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102445:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4200) 00010000:00010000:1.0:1788930253.102448:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788930253.102454:0:18961:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e59c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102460:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e59c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102473:0:18961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102479:0:18961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102485:0:18961:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102490:0:18961:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930253.102500:0:18961:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102506:0:18961:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102513:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d2e8528de00) 00010000:00010000:1.0:1788930253.102516:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788930253.102518:0:18961:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.102524:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.103759:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e595 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210850 expref: 12 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.103783:0:18961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75600/0xce4472dd2237e5aa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210850 expref: 11 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.103791:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2e907e4f00) 00010000:00010000:1.0:1788930253.103793:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788930253.103796:0:18961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a75600, rc 0) 00000100:00100000:1.0:1788930253.103882:0:18961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+11:17427:x1875828747158016:12345-192.168.204.40@tcp:101:bash.0 Request processed in 2021us (2252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930253.103890:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 27 00000100:00100000:2.0:1788930253.114691:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930253.120308:0:20889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747158272 00000100:00100000:0.0:1788930253.120323:0:20889:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747158272 00000100:00100000:0.0:1788930253.120399:0:20889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 28 00000100:00100000:0.0:1788930253.120410:0:20889:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+11:17427:x1875828747158272:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:0.0:1788930253.120435:0:20889:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788930253.120454:0:20889:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237e5b1 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210857 expref: -99 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.120803:0:20889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e5b8 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.120819:0:20889:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e58e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210849 expref: 11 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.120828:0:20889:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e5b8 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.120878:0:20889:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e58e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210849 expref: 11 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.120890:0:20889:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e58e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210849 expref: 11 pid: 20889 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930253.120904:0:20889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88160e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20889:1875828770217088:192.168.204.40@tcp:104: 00000100:00100000:0.0:1788930253.121008:0:20889:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8773e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788930253.125384:0:20889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88160e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20889:1875828770217088:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788930253.125424:0:20889:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e5b8 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930253.131959:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930253.132208:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747158400 00000100:00100000:0.0:1788930253.132220:0:18946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747158400 00010000:00010000:0.0:1788930253.132299:0:18946:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e58e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210849 expref: 12 pid: 20889 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930253.132338:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:0.0:1788930253.132347:0:18946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a847aba8-b811-46f0-8caf-0cdd775ee205+12:2361:x1875828747158400:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788930253.132362:0:18946:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788930253.132369:0:18946:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e58e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210849 expref: 12 pid: 20889 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.132382:0:18946:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e58e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210849 expref: 12 pid: 20889 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.132404:0:18946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e58e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210849 expref: 12 pid: 20889 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.132421:0:18946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2e907e4f00) 00010000:00010000:0.0:1788930253.132441:0:18946:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e5b8 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.132453:0:18946:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e5b8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.132460:0:18946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e5b8 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.132486:0:18946:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788930253.132608:0:18946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a847aba8-b811-46f0-8caf-0cdd775ee205+11:2361:x1875828747158400:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 261us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930253.132616:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 10 00010000:00010000:1.0:1788930253.132723:0:20889:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e5b8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.132731:0:20889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e5b8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.132794:0:20889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e5bf lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.132804:0:20889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e5bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.132812:0:20889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e5bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.133507:0:20889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5c6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.133518:0:20889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5c6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.133525:0:20889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5c6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788930253.133537:0:20889:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788930253.133562:0:20889:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e5b8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.133570:0:20889:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e5b8 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.133577:0:20889:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e5b8 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.133590:0:20889:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930253.133595:0:20889:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e5b8 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.133602:0:20889:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e5b8 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.133613:0:20889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2e907e4f00) 00010000:00010000:1.0:1788930253.133616:0:20889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788930253.133620:0:20889:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e5b8 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.133627:0:20889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8400/0xce4472dd2237e5b8 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788930253.133638:0:20889:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a48f5941 reply state 00000000ff2559b0 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e5bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930253.133648:0:20889:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788930253.133686:0:20889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8800/0xce4472dd2237e5b1 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210857 expref: 14 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.133700:0:20889:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5c6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210857 expref: 13 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.133708:0:20889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d2e8528da00) 00010000:00010000:1.0:1788930253.133711:0:20889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788930253.133713:0:20889:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a74a00, rc 0) 00000100:00100000:1.0:1788930253.133753:0:20889:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+14:17427:x1875828747158272:12345-192.168.204.40@tcp:101:bash.0 Request processed in 13345us (19075us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788930253.133765:0:20889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 28 00010000:00010000:1.0:1788930253.139824:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e5bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.139841:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e5bf lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.139849:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e5bf lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.139855:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a75a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930253.139860:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e5bf lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.139868:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e5bf lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.139885:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8d2e8528de00) 00010000:00010000:1.0:1788930253.139889:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788930253.139894:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e5bf lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.139900:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e5bf lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930253.157589:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930253.157657:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747158528 00000100:00100000:1.0:1788930253.157667:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747158528 00000100:00100000:1.0:1788930253.157735:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 29 00000100:00100000:1.0:1788930253.157745:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+13:17427:x1875828747158528:12345-192.168.204.40@tcp:101:bash.0 00010000:00010000:1.0:1788930253.157773:0:18962:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930253.157827:0:18962:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e5d4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021085e expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.157906:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e5db lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.157919:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e5db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.157930:0:18962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e5db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788930253.157973:0:18962:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788930253.157977:0:18962:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788930253.157997:0:18962:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e5db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.158009:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e5db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.158048:0:18962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e5d4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021085e expref: 15 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.158067:0:18962:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e5db lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021085e expref: 14 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.158076:0:18962:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d2e8528da00) 00010000:00010000:1.0:1788930253.158079:0:18962:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788930253.158082:0:18962:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a74400, rc 0) 00000100:00100000:1.0:1788930253.158159:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+14:17427:x1875828747158528:12345-192.168.204.40@tcp:101:bash.0 Request processed in 415us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930253.158176:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 29 00000100:00100000:3.0:1788930253.160499:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930253.160639:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747158784 00000100:00100000:1.0:1788930253.160651:0:18965:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747158784 00000100:00100000:1.0:1788930253.160714:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:1.0:1788930253.160724:0:18965:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+14:17427:x1875828747158784:12345-192.168.204.40@tcp:35:bash.0 00000001:00080000:1.0:1788930253.161121:0:18965:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901897 00000100:00100000:1.0:1788930253.161251:0:18965:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+16:17427:x1875828747158784:12345-192.168.204.40@tcp:35:bash.0 Request processed in 502us (735us total) trans 12884901898 rc 0/0 00000100:00100000:1.0:1788930253.161259:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5 00000020:00080000:1.0:1788930253.161263:0:18965:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1788930253.211991:0:18994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788930253.275349:0:18958:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788930253.275362:0:18958:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2e9824f800 from 10 10000000:01000000:0.0:1788930253.275383:0:18958:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788930253.275431:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237e5e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.275447:0:18958:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237e5e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.275461:0:18958:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237e5e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930253.275473:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788930253.275492:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88161f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770217344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788930253.275600:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930253.275713:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2d8773e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788930253.279775:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770217216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788930253.279861:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930253.280365:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770217216 00000100:00100000:1.0:1788930253.280380:0:19648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770217216 00000100:00100000:1.0:1788930253.280562:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788930253.280576:0:19648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770217216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788930253.280721:0:19648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788930253.280803:0:19648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875828770217216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 230us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930253.280810:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788930253.282803:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875828770217216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788930253.285518:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770217344 00000100:00100000:2.0:1788930253.285548:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770217344 00000100:00100000:2.0:1788930253.285623:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788930253.285634:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84571450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+16:18958:x1875828770217344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788930253.285655:0:18955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930253.285692:0:18955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2d8566e600/0xce4472dd2237e5e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237e5e2 expref: -99 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.285728:0:18955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2d8566e600/0xce4472dd2237e5e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237e5e2 expref: 17 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.285741:0:18955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2d8566e600/0xce4472dd2237e5e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e5e2 expref: 17 pid: 18955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.285751:0:18955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8566e600, rc 0) 00000100:00100000:2.0:1788930253.285848:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84571450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+17:18958:x1875828770217344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 216us (10248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930253.285855:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788930253.285917:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88161f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770217344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788930253.286183:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237e5e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e5e9 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.286196:0:18958:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237e5e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237e5e9 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930253.286304:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87ccea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770217472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788930253.286340:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930253.286460:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e86311480 going to sleep for 11 seconds 00000100:00100000:2.0:1788930253.286478:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770217472 00000100:00100000:2.0:1788930253.286484:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770217472 00000100:00100000:2.0:1788930253.286509:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788930253.286516:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84573450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+17:18958:x1875828770217472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788930253.287181:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84573450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+17:18958:x1875828770217472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 663us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930253.287189:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788930253.287721:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87ccea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770217472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788930253.287778:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e90314380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770217600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788930253.287829:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788930253.287869:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2eb5b07900 going to sleep for 11 seconds 00000100:00100000:2.0:1788930253.290036:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770217600 00000100:00100000:2.0:1788930253.290053:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770217600 00000100:00100000:2.0:1788930253.290138:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788930253.290150:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+17:18958:x1875828770217600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788930253.290494:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84571c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+17:18958:x1875828770217600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 345us (2662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930253.290514:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788930253.290797:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e90314380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770217600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788930253.292300:0:21087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788930253.292687:0:18958:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788930253.292715:0:18958:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788930253.292727:0:18958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237e5e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e5e9 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.292740:0:18958:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2ebe0b8a00/0xce4472dd2237e5e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e5e9 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930253.292753:0:18958:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788930253.292756:0:18958:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2eb5425800 from 10 10000000:01000000:2.0:1788930253.292760:0:18958:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788930253.292805:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8566ee00/0xce4472dd2237e5f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.292813:0:18958:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2d8566ee00/0xce4472dd2237e5f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.292824:0:18958:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2d8566ee00/0xce4472dd2237e5f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930253.292848:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87ccce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770217728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788930253.292979:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930253.293033:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788930253.297069:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770217728 00000100:00100000:3.0:1788930253.297118:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770217728 00000100:00100000:3.0:1788930253.297189:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788930253.297202:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84571050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+17:18958:x1875828770217728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788930253.297219:0:18956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930253.297253:0:18956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237e5f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237e5f0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930253.297281:0:18956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237e5f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237e5f0 expref: 18 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930253.297293:0:18956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc596600/0xce4472dd2237e5f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e5f0 expref: 18 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930253.297302:0:18956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596600, rc 0) 00000100:00100000:3.0:1788930253.297381:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84571050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+18:18958:x1875828770217728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (4402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930253.297387:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788930253.298402:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87ccce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770217728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788930253.298424:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2d8566ee00/0xce4472dd2237e5f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e5f7 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.298435:0:18958:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2d8566ee00/0xce4472dd2237e5f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237e5f7 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930253.298527:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87ccce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770217856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788930253.298572:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930253.298720:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d5600 going to sleep for 11 seconds 00000100:00100000:0.0:1788930253.299610:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770217856 00000100:00100000:0.0:1788930253.299625:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770217856 00000100:00100000:0.0:1788930253.299708:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788930253.299728:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+18:18958:x1875828770217856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788930253.300430:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+18:18958:x1875828770217856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 701us (1854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930253.300439:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788930253.300528:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87ccce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770217856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788930253.300587:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87ccce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770217984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788930253.300651:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930253.303148:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788930253.303345:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770217984 00000100:00100000:3.0:1788930253.303358:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770217984 00000100:00100000:3.0:1788930253.303417:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788930253.303427:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+18:18958:x1875828770217984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788930253.303710:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+18:18958:x1875828770217984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 283us (3056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930253.303718:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788930253.309280:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930253.309318:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747159040 00000100:00100000:3.0:1788930253.309329:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747159040 00000100:00100000:3.0:1788930253.309387:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 30 00000100:00100000:3.0:1788930253.309398:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+16:17437:x1875828747159040:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:3.0:1788930253.309443:0:18963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930253.309467:0:18963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237e5fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210865 expref: -99 pid: 18963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788930253.309578:0:18963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788930253.309788:0:18963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237e5fe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210865 expref: 18 pid: 18963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930253.309803:0:18963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d2e907e4200) 00010000:00010000:3.0:1788930253.309806:0:18963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788930253.309811:0:18963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596200/0xce4472dd2237e5fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210865 expref: 18 pid: 18963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930253.309826:0:18963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc596200, rc 0) 00000100:00100000:3.0:1788930253.309959:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+17:17437:x1875828747159040:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 562us (688us total) trans 12884901899 rc 301/301 00000100:00100000:3.0:1788930253.309967:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 30 00000100:00100000:2.0:1788930253.310778:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87ccce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770217984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788930253.311459:0:21088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788930253.311515:0:18958:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788930253.311534:0:18958:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788930253.311545:0:18958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8566ee00/0xce4472dd2237e5f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e5f7 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.311555:0:18958:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2d8566ee00/0xce4472dd2237e5f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e5f7 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788930253.311565:0:18958:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788930253.311568:0:18958:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d2e863d1000 from 10 10000000:01000000:2.0:1788930253.311570:0:18958:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788930253.311625:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8566ea00/0xce4472dd2237e60c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.311633:0:18958:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.140@tcp lock: ffff8d2d8566ea00/0xce4472dd2237e60c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.311658:0:18958:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.140@tcp lock: ffff8d2d8566ea00/0xce4472dd2237e60c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930253.311680:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87ccce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770218112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788930253.311741:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930253.311777:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788930253.312985:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770218112 00000100:00100000:3.0:1788930253.312998:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770218112 00000100:00100000:3.0:1788930253.313048:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788930253.313060:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+18:18958:x1875828770218112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788930253.313078:0:18956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788930253.313113:0:18956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d2ebc597c00/0xce4472dd2237e613 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xce4472dd2237e60c expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930253.313150:0:18956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d2ebc597c00/0xce4472dd2237e613 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xce4472dd2237e60c expref: 19 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930253.313179:0:18956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d2ebc597c00/0xce4472dd2237e613 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xce4472dd2237e60c expref: 19 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930253.313189:0:18956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2ebc597c00, rc 0) 00000100:00100000:3.0:1788930253.313297:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:18958:x1875828770218112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 239us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930253.313304:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788930253.313783:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930253.314190:0:18964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747159296 00000100:00100000:0.0:1788930253.314198:0:18964:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747159296 00000100:00100000:0.0:1788930253.314273:0:18964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:0.0:1788930253.314282:0:18964:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+17:17437:x1875828747159296:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:0.0:1788930253.314541:0:18964:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+18:17437:x1875828747159296:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 259us (760us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1788930253.314549:0:18964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:2.0:1788930253.314796:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87ccce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770218112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788930253.314823:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.140@tcp lock: ffff8d2d8566ea00/0xce4472dd2237e60c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e613 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.314835:0:18958:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.140@tcp lock: ffff8d2d8566ea00/0xce4472dd2237e60c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xce4472dd2237e613 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930253.314927:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87ccce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770218240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788930253.314976:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930253.315026:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d5600 going to sleep for 11 seconds 00000100:00100000:1.0:1788930253.315234:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770218240 00000100:00100000:1.0:1788930253.315241:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770218240 00000100:00100000:1.0:1788930253.315284:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788930253.315294:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:18958:x1875828770218240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788930253.316250:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:18958:x1875828770218240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 953us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930253.316261:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788930253.316289:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87ccce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770218240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788930253.316339:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87ccce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770218368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788930253.316386:0:18958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930253.316414:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d5600 going to sleep for 11 seconds 00000100:00100000:2.0:1788930253.317931:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770218368 00000100:00100000:2.0:1788930253.317947:0:18956:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770218368 00000100:00100000:2.0:1788930253.318007:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788930253.318017:0:18956:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:18958:x1875828770218368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788930253.318304:0:18956:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:18958:x1875828770218368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 288us (1916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930253.318318:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788930253.318520:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87ccce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c52ce1e4-e465-4485-9875-0a24e445f9ec:18958:1875828770218368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788930253.331746:0:21089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788930253.337682:0:18958:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788930253.337741:0:18958:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788930253.337758:0:18958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.140@tcp lock: ffff8d2d8566ea00/0xce4472dd2237e60c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e613 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.337773:0:18958:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.140@tcp lock: ffff8d2d8566ea00/0xce4472dd2237e60c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xce4472dd2237e613 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930253.362110:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930253.362216:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747159552 00000100:00100000:1.0:1788930253.362262:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747159552 00000100:00100000:1.0:1788930253.362334:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 31 00000100:00100000:1.0:1788930253.362347:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+18:17440:x1875828747159552:12345-192.168.204.40@tcp:101:lfs.0 00010000:00010000:1.0:1788930253.362377:0:18962:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930253.362402:0:18962:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e61a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021086c expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.362519:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237e621 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.362537:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237e621 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.362551:0:18962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237e621 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788930253.362562:0:18962:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788930253.362886:0:18962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e61a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021086c expref: 21 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.363031:0:18962:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237e621 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021086c expref: 20 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.363041:0:18962:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d2e8528da00) 00010000:00010000:1.0:1788930253.363044:0:18962:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788930253.363050:0:18962:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a74e00, rc 0) 00000100:00100000:1.0:1788930253.363146:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+20:17440:x1875828747159552:12345-192.168.204.40@tcp:101:lfs.0 Request processed in 802us (1058us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1788930253.363171:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 31 00000100:00100000:0.0:1788930253.368348:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930253.368552:0:21074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747159680 00000100:00100000:3.0:1788930253.368563:0:21074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747159680 00000100:00100000:3.0:1788930253.368652:0:21074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:3.0:1788930253.368665:0:21074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88162680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+20:2360:x1875828747159680:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788930253.368683:0:21074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788930253.368708:0:21074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74e00/0xce4472dd2237e621 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021086c expref: 20 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930253.368726:0:21074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d2e8528da00) 00010000:00010000:3.0:1788930253.368732:0:21074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788930253.368793:0:21074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88162680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+19:2360:x1875828747159680:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 130us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930253.368801:0:21074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:3.0:1788930253.371533:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930253.371810:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747159808 00000100:00100000:0.0:1788930253.371821:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747159808 00000100:00100000:0.0:1788930253.371997:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 32 00000100:00100000:0.0:1788930253.372012:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+19:17440:x1875828747159808:12345-192.168.204.40@tcp:54:lfs.0 00010000:00010000:0.0:1788930253.372089:0:18963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e62f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.372116:0:18963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e62f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.372128:0:18963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e62f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.372163:0:18963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e62f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.372188:0:18963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e62f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.372194:0:18963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e62f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.372200:0:18963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788930253.372204:0:18963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e62f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.372212:0:18963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e62f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.372389:0:18963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d2e8528da00) 00010000:00010000:0.0:1788930253.372393:0:18963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788930253.372399:0:18963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e62f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.372405:0:18963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebe0b8200/0xce4472dd2237e62f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930253.373867:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+19:17440:x1875828747159808:12345-192.168.204.40@tcp:54:lfs.0 Request processed in 1835us (2320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930253.373882:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 32 00000100:00100000:0.0:1788930253.378455:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930253.378560:0:18964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747160064 00000100:00100000:2.0:1788930253.378571:0:18964:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747160064 00000100:00100000:2.0:1788930253.378634:0:18964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:2.0:1788930253.378646:0:18964:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+19:17440:x1875828747160064:12345-192.168.204.40@tcp:35:lfs.0 00000100:00100000:2.0:1788930253.378981:0:18964:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+20:17440:x1875828747160064:12345-192.168.204.40@tcp:35:lfs.0 Request processed in 335us (535us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788930253.378989:0:18964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 7 00010000:00010000:1.0:1788930253.660236:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930253.669758:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930253.675423:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747160320 00000100:00100000:2.0:1788930253.675447:0:18961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747160320 00000100:00100000:2.0:1788930253.675527:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 33 00000100:00100000:2.0:1788930253.675747:0:18961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+20:17471:x1875828747160320:12345-192.168.204.40@tcp:101:cat.0 00010000:00010000:2.0:1788930253.675774:0:18961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930253.675797:0:18961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fe00/0xce4472dd2237e636 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210873 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.675933:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f600/0xce4472dd2237e63d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.675947:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f600/0xce4472dd2237e63d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.675959:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f600/0xce4472dd2237e63d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788930253.675969:0:18961:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788930253.676134:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fe00/0xce4472dd2237e636 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210873 expref: 23 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.676153:0:18961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f600/0xce4472dd2237e63d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210873 expref: 22 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.676163:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d2e8528da00) 00010000:00010000:2.0:1788930253.676165:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788930253.676170:0:18961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8566f600, rc 0) 00000100:00100000:2.0:1788930253.676287:0:18961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+22:17471:x1875828747160320:12345-192.168.204.40@tcp:101:cat.0 Request processed in 543us (6542us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1788930253.683220:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930253.683539:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930253.683713:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747160448 00000100:00100000:0.0:1788930253.683723:0:18946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747160448 00000100:00100000:0.0:1788930253.683837:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1 00000100:00100000:0.0:1788930253.683849:0:18946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90316a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+23:2362:x1875828747160448:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788930253.683866:0:18946:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788930253.683891:0:18946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f600/0xce4472dd2237e63d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210873 expref: 23 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.683925:0:18946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d2e8528da00) 00010000:00010000:0.0:1788930253.683931:0:18946:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788930253.683994:0:18946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90316a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+22:2362:x1875828747160448:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 147us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930253.684002:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1 00000100:00100000:2.0:1788930253.684076:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 33 00000100:00100000:1.0:1788930253.684352:0:18964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747160704 00000100:00100000:1.0:1788930253.684358:0:18964:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747160704 00000100:00100000:0.0:1788930253.685015:0:18964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:0.0:1788930253.685025:0:18964:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+21:17471:x1875828747160704:12345-192.168.204.40@tcp:35:cat.0 00000100:00100000:0.0:1788930253.685597:0:18964:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+22:17471:x1875828747160704:12345-192.168.204.40@tcp:35:cat.0 Request processed in 572us (2057us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1788930253.685605:0:18964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 8 00000100:00100000:3.0:1788930253.755220:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930253.755446:0:20889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747160960 00000100:00100000:1.0:1788930253.755458:0:20889:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747160960 00000100:00100000:1.0:1788930253.755583:0:20889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 34 00000100:00100000:1.0:1788930253.755595:0:20889:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+22:17477:x1875828747160960:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:1.0:1788930253.755621:0:20889:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930253.755643:0:20889:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e64b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021087a expref: -99 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.755780:0:20889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e652 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.755798:0:20889:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5c6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210857 expref: 23 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.755807:0:20889:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e5db lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021085e expref: 23 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.755814:0:20889:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e652 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.755851:0:20889:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e5db lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021085e expref: 23 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.755866:0:20889:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e5db lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021085e expref: 23 pid: 18962 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930253.755889:0:20889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20889:1875828770218496:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788930253.756005:0:20889:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5c6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210857 expref: 23 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.756014:0:20889:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5c6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210857 expref: 23 pid: 20889 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930253.756024:0:20889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20889:1875828770218624:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788930253.756047:0:20889:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e983d5600 going to sleep for 11 seconds 00000100:00100000:1.0:1788930253.759878:0:20889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20889:1875828770218496:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788930253.759896:0:20889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20889:1875828770218624:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788930253.759921:0:20889:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e652 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930253.762424:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930253.762472:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930253.762811:0:21074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747161088 00000100:00100000:0.0:1788930253.762822:0:21074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747161088 00010000:00010000:0.0:1788930253.762867:0:21074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e5db lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021085e expref: 24 pid: 18962 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930253.762899:0:21074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747161216 00000100:00100000:0.0:1788930253.762903:0:21074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747161216 00010000:00010000:0.0:1788930253.763071:0:21074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5c6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210857 expref: 25 pid: 20889 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930253.763118:0:21074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:0.0:1788930253.763129:0:21074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86dab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+25:2361:x1875828747161088:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788930253.763147:0:21074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788930253.763154:0:21074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e5db lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021085e expref: 25 pid: 18962 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.763189:0:21074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e5db lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021085e expref: 25 pid: 18962 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.763212:0:21074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e5db lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca7164021085e expref: 25 pid: 18962 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.763260:0:21074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d2e8528da00) 00010000:00010000:0.0:1788930253.763266:0:21074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e652 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.763275:0:21074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e652 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.763282:0:21074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788930253.763338:0:21074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86dab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+24:2361:x1875828747161088:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 212us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930253.763346:0:21074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:0.0:1788930253.763395:0:21074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:0.0:1788930253.763401:0:21074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+23:2361:x1875828747161216:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788930253.763410:0:21074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788930253.763415:0:21074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5c6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210857 expref: 23 pid: 20889 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.763425:0:21074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5c6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210857 expref: 23 pid: 20889 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.763449:0:21074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e5c6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.40@tcp remote: 0xa85ca71640210857 expref: 23 pid: 20889 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.763458:0:21074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d2e8528da00) 00010000:00010000:0.0:1788930253.763462:0:21074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e652 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.763470:0:21074:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e652 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.763478:0:21074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e652 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930253.763500:0:21074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788930253.763520:0:21074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+22:2361:x1875828747161216:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 119us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788930253.763526:0:21074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 12 00010000:00010000:1.0:1788930253.763730:0:20889:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e652 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.763739:0:20889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e652 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20889 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788930253.763762:0:20889:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788930253.763970:0:20889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e64b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021087a expref: 23 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.763985:0:20889:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75400/0xce4472dd2237e652 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021087a expref: 22 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.764006:0:20889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d2e8528da00) 00010000:00010000:1.0:1788930253.764009:0:20889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788930253.764011:0:20889:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a75400, rc 0) 00000100:00100000:1.0:1788930253.764415:0:20889:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+22:17477:x1875828747160960:12345-192.168.204.40@tcp:101:dd.0 Request processed in 8821us (9205us total) trans 12884901905 rc 0/0 00000100:00100000:1.0:1788930253.764423:0:20889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 34 00000100:00100000:1.0:1788930253.773450:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930253.773582:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747161472 00000100:00100000:2.0:1788930253.773594:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747161472 00000100:00100000:2.0:1788930253.773687:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 35 00000100:00100000:2.0:1788930253.773698:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+22:17477:x1875828747161472:12345-192.168.204.40@tcp:36:dd.0 00010000:00010000:2.0:1788930253.775164:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fe00/0xce4472dd2237e660 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.775197:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fe00/0xce4472dd2237e660 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.775210:0:18962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fe00/0xce4472dd2237e660 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788930253.775336:0:18962:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901906 00000004:00010000:2.0:1788930253.775361:0:18962:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000553e0a2f reply state 00000000eef62792 transno 12884901907 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fe00/0xce4472dd2237e660 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930253.775369:0:18962:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788930253.775514:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+25:17477:x1875828747161472:12345-192.168.204.40@tcp:36:dd.0 Request processed in 1814us (2075us total) trans 12884901907 rc 0/0 00000100:00100000:2.0:1788930253.775522:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 35 00000020:00080000:2.0:1788930253.775528:0:18962:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788930253.777873:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fe00/0xce4472dd2237e660 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930253.777895:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fe00/0xce4472dd2237e660 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930253.777903:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fe00/0xce4472dd2237e660 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930253.777910:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8566fe00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788930253.778217:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fe00/0xce4472dd2237e660 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930253.778264:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fe00/0xce4472dd2237e660 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930253.778282:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d2e8528da00) 00010000:00010000:3.0:1788930253.778286:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788930253.778291:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fe00/0xce4472dd2237e660 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930253.778298:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fe00/0xce4472dd2237e660 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930253.787367:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930253.787671:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747161600 00000100:00100000:2.0:1788930253.787682:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747161600 00000100:00100000:2.0:1788930253.787832:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 36 00000100:00100000:2.0:1788930253.787844:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+24:17477:x1875828747161600:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:2.0:1788930253.787878:0:18963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930253.787900:0:18963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e800/0xce4472dd2237e667 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210881 expref: -99 pid: 18963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.788182:0:18963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e800/0xce4472dd2237e667 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210881 expref: 25 pid: 18963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.788200:0:18963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e800/0xce4472dd2237e667 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210881 expref: 25 pid: 18963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.788281:0:18963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d2e8528da00) 00010000:00010000:2.0:1788930253.788284:0:18963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788930253.788288:0:18963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8566e800, rc 0) 00000100:00100000:2.0:1788930253.788897:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+25:17477:x1875828747161600:12345-192.168.204.40@tcp:101:dd.0 Request processed in 1053us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930253.788907:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 36 00000100:00100000:0.0:1788930253.806309:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930253.810822:0:21074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747161856 00000100:00100000:3.0:1788930253.810838:0:21074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747161856 00000100:00100000:3.0:1788930253.811159:0:21074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:3.0:1788930253.811171:0:21074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88162300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+25:17477:x1875828747161856:12345-192.168.204.40@tcp:103:dd.0 00010000:00010000:3.0:1788930253.811189:0:21074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788930253.811256:0:21074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e800/0xce4472dd2237e667 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210881 expref: 25 pid: 18963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930253.811276:0:21074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d2e8528da00) 00010000:00010000:3.0:1788930253.811281:0:21074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788930253.811347:0:21074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88162300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+24:17477:x1875828747161856:12345-192.168.204.40@tcp:103:dd.0 Request processed in 179us (5049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930253.811355:0:21074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:1.0:1788930253.817776:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930253.817882:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747161984 00000100:00100000:2.0:1788930253.817895:0:18961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747161984 00000100:00100000:2.0:1788930253.817969:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 37 00000100:00100000:2.0:1788930253.817980:0:18961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+24:17477:x1875828747161984:12345-192.168.204.40@tcp:58:dd.0 00010000:00010000:2.0:1788930253.818326:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e000/0xce4472dd2237e66e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.818344:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e000/0xce4472dd2237e66e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930253.818356:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e000/0xce4472dd2237e66e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788930253.819895:0:18961:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788930253.820194:0:18961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1788930253.820414:0:18961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1788930253.820776:0:18961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+24:17477:x1875828747161984:12345-192.168.204.40@tcp:58:dd.0 Request processed in 2794us (3007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930253.820787:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 37 00000100:00100000:0.0:1788930253.823727:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930253.823855:0:20889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747162112 00000100:00100000:1.0:1788930253.823866:0:20889:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747162112 00000100:00100000:1.0:1788930253.824035:0:20889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 38 00000100:00100000:1.0:1788930253.824047:0:20889:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+24:17477:x1875828747162112:12345-192.168.204.40@tcp:101:dd.0 00010000:00010000:1.0:1788930253.824075:0:20889:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930253.824105:0:20889:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e675 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210888 expref: -99 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.824165:0:20889:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e000/0xce4472dd2237e66e lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.824177:0:20889:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e675 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210888 expref: 25 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.824197:0:20889:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e000/0xce4472dd2237e66e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.824210:0:20889:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e675 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210888 expref: 25 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.824768:0:20889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d2e8528da00) 00010000:00010000:1.0:1788930253.824772:0:20889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788930253.824777:0:20889:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e675 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210888 expref: 25 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930253.824786:0:20889:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a75a00, rc 0) 00000100:00100000:1.0:1788930253.824853:0:20889:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+25:17477:x1875828747162112:12345-192.168.204.40@tcp:101:dd.0 Request processed in 808us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930253.824861:0:20889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 38 00000040:00080000:2.0:1788930254.235523:0:18994:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788930254.235533:0:18994:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788930254.235576:0:18994:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788930254.235584:0:18994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788930254.235712:0:18994:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87cce300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18994:1875828770218752:192.168.204.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788930254.235855:0:18994:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d22600 going to sleep for 11 seconds 00000100:00100000:0.0:1788930254.244961:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930254.245099:0:18972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747162240 00000100:00100000:3.0:1788930254.245109:0:18972:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747162240 00000100:00100000:3.0:1788930254.245180:0:18972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:3.0:1788930254.245190:0:18972:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+26:17478:x1875828747162240:12345-192.168.204.40@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788930254.245294:0:18972:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+26:17478:x1875828747162240:12345-192.168.204.40@tcp:900:lhsmtool_posix.0 Request processed in 106us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930254.245301:0:18972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00080000:0.0:1788930254.245403:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788930254.249291:0:18994:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87cce300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18994:1875828770218752:192.168.204.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788930254.257498:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930254.257593:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747162368 00000100:00100000:1.0:1788930254.257604:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747162368 00000100:00100000:1.0:1788930254.257659:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 39 00000100:00100000:1.0:1788930254.257669:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+25:17478:x1875828747162368:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788930254.257702:0:18962:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788930254.257828:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+25:17478:x1875828747162368:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 Request processed in 160us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930254.257835:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 39 00000100:00100000:0.0:1788930254.275265:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930254.275344:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747162496 00000100:00100000:2.0:1788930254.275355:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747162496 00000100:00100000:2.0:1788930254.275415:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 40 00000100:00100000:2.0:1788930254.275426:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+25:17478:x1875828747162496:12345-192.168.204.40@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788930254.275499:0:18963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f800/0xce4472dd2237e67c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275517:0:18963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f800/0xce4472dd2237e67c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275533:0:18963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f800/0xce4472dd2237e67c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275586:0:18963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e683 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275594:0:18963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e683 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275601:0:18963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e683 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275624:0:18963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e68a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275651:0:18963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e68a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275659:0:18963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e68a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788930254.275705:0:18963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788930254.275710:0:18963:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788930254.275727:0:18963:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e68a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275739:0:18963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f800/0xce4472dd2237e67c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275746:0:18963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f800/0xce4472dd2237e67c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275766:0:18963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f800/0xce4472dd2237e67c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275773:0:18963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8566f800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930254.275777:0:18963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f800/0xce4472dd2237e67c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275784:0:18963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f800/0xce4472dd2237e67c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275796:0:18963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2e907e4100) 00010000:00010000:2.0:1788930254.275799:0:18963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930254.275805:0:18963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f800/0xce4472dd2237e67c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275822:0:18963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f800/0xce4472dd2237e67c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275835:0:18963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e683 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275843:0:18963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e683 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275848:0:18963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e683 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275852:0:18963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8566e400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930254.275855:0:18963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e683 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275861:0:18963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e683 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275868:0:18963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8d2e98756100) 00010000:00010000:2.0:1788930254.275871:0:18963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930254.275873:0:18963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e683 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275878:0:18963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e683 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275891:0:18963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e68a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275896:0:18963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e68a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275908:0:18963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e68a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275913:0:18963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8566fc00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930254.275915:0:18963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e68a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275921:0:18963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e68a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275929:0:18963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d2e8528da00) 00010000:00010000:2.0:1788930254.275931:0:18963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930254.275933:0:18963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e68a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.275938:0:18963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e68a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930254.276015:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+25:17478:x1875828747162496:12345-192.168.204.40@tcp:34:lhsmtool_posix.0 Request processed in 589us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930254.276023:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 40 00000100:00100000:0.0:1788930254.281411:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930254.281472:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747162752 00000100:00100000:1.0:1788930254.281484:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747162752 00000100:00100000:1.0:1788930254.281554:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 41 00000100:00100000:1.0:1788930254.281564:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+25:17478:x1875828747162752:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788930254.281588:0:18962:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930254.281609:0:18962:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74200/0xce4472dd2237e691 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021088f expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.281732:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237e698 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.281761:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237e698 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.281775:0:18962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237e698 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788930254.281788:0:18962:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788930254.281893:0:18962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237e698 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.281900:0:18962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237e698 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.281906:0:18962:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237e698 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.281912:0:18962:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930254.281916:0:18962:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237e698 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.281924:0:18962:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237e698 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.281935:0:18962:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d2e8528da00) 00010000:00010000:1.0:1788930254.281938:0:18962:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788930254.281943:0:18962:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237e698 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.281960:0:18962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237e698 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.282004:0:18962:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74200/0xce4472dd2237e691 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021088f expref: 27 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.282013:0:18962:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d2e907e4100) 00010000:00010000:1.0:1788930254.282015:0:18962:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788930254.282019:0:18962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74200/0xce4472dd2237e691 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021088f expref: 27 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.282028:0:18962:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a74200, rc 0) 00000100:00100000:1.0:1788930254.282101:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+26:17478:x1875828747162752:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 537us (700us total) trans 12884901908 rc 301/301 00000100:00100000:1.0:1788930254.282110:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 41 00000100:00100000:0.0:1788930254.296698:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930254.296904:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747162880 00000100:00100000:2.0:1788930254.296915:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747162880 00000100:00100000:2.0:1788930254.296975:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 42 00000100:00100000:2.0:1788930254.296985:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+26:17478:x1875828747162880:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788930254.297018:0:18963:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788930254.297137:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+26:17478:x1875828747162880:12345-192.168.204.40@tcp:53:lhsmtool_posix.0 Request processed in 153us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930254.297164:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 42 00000100:00100000:0.0:1788930254.300318:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930254.300417:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747163136 00000100:00100000:1.0:1788930254.300427:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747163136 00000100:00100000:1.0:1788930254.300493:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 43 00000100:00100000:1.0:1788930254.300504:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+26:17478:x1875828747163136:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788930254.300531:0:18962:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930254.300557:0:18962:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74200/0xce4472dd2237e6a6 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca71640210896 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788930254.301287:0:18962:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =60 00000004:00080000:1.0:1788930254.301295:0:18962:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+60 in llog 00000004:00080000:1.0:1788930254.301344:0:18962:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x42:0x0], index 1: 0 00010000:00010000:1.0:1788930254.301606:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237e6ad lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.301627:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237e6ad lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.301640:0:18962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237e6ad lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.301706:0:18962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74200/0xce4472dd2237e6a6 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210896 expref: 29 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.301725:0:18962:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237e6ad lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210896 expref: 28 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.301733:0:18962:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2e8528de00) 00010000:00010000:1.0:1788930254.301736:0:18962:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788930254.301740:0:18962:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a74800, rc 0) 00000100:00100000:1.0:1788930254.301801:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+28:17478:x1875828747163136:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 1298us (1493us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1788930254.301809:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 43 00000100:00100000:0.0:1788930254.308180:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930254.308282:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747163392 00000100:00100000:2.0:1788930254.308294:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747163392 00000100:00100000:2.0:1788930254.308356:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 44 00000100:00100000:2.0:1788930254.308368:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+28:17478:x1875828747163392:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788930254.308436:0:18963:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788930254.308472:0:18963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237e6ad lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210896 expref: 28 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.308493:0:18963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2e8528de00) 00010000:00010000:2.0:1788930254.308503:0:18963:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788930254.308539:0:18963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e6bb lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.308556:0:18963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e6bb lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.308567:0:18963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e6bb lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.308582:0:18963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6c2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb13a6ac7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.308589:0:18963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6c2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb13a6ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.308595:0:18963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6c2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb13a6ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.308679:0:18963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e6bb lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.308687:0:18963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e6bb lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.308693:0:18963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e6bb lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.308699:0:18963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8566fc00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930254.308704:0:18963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e6bb lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.308711:0:18963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e6bb lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.308720:0:18963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d2e907e4f00) 00010000:00010000:2.0:1788930254.308723:0:18963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930254.308727:0:18963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e6bb lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.308733:0:18963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e6bb lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.308742:0:18963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6c2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb13a6ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.308747:0:18963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6c2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb13a6ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.308766:0:18963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6c2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb13a6ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.308777:0:18963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8566e400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930254.308780:0:18963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6c2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb13a6ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.308787:0:18963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6c2 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb13a6ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.308795:0:18963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb13a6ac7 (ffff8d2e98756100) 00010000:00010000:2.0:1788930254.308797:0:18963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788930254.308800:0:18963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6c2 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb13a6ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.308806:0:18963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6c2 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb13a6ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930254.308892:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+27:17478:x1875828747163392:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 Request processed in 525us (722us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788930254.308899:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 44 00000100:00100000:0.0:1788930254.318154:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930254.318497:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747163520 00000100:00100000:1.0:1788930254.318507:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747163520 00000100:00100000:1.0:1788930254.318576:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 45 00000100:00100000:1.0:1788930254.318587:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+27:17478:x1875828747163520:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788930254.318608:0:18962:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788930254.318633:0:18962:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74200/0xce4472dd2237e6c9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca7164021089d expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.318677:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237e6d0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.318698:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237e6d0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.318711:0:18962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237e6d0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.318816:0:18962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74200/0xce4472dd2237e6c9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021089d expref: 29 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.318834:0:18962:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74800/0xce4472dd2237e6d0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca7164021089d expref: 28 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.318842:0:18962:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2e8528dc00) 00010000:00010000:1.0:1788930254.318845:0:18962:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788930254.318849:0:18962:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d86a74800, rc 0) 00000100:00100000:1.0:1788930254.318909:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+28:17478:x1875828747163520:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 323us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930254.318925:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 45 00000100:00100000:0.0:1788930254.323502:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930254.323599:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747163776 00000100:00100000:2.0:1788930254.323609:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747163776 00000100:00100000:2.0:1788930254.323664:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 46 00000100:00100000:2.0:1788930254.323676:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+28:17478:x1875828747163776:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788930254.323774:0:18963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6d7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.323793:0:18963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6d7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.323815:0:18963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6d7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788930254.324296:0:18963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:2.0:1788930254.324307:0:18963:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 639480082249ns, next at 640480080169ns, rc = 0 00000004:00010000:2.0:1788930254.324387:0:18963:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e56e241f reply state 0000000075163294 transno 12884901910 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6d7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930254.324397:0:18963:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788930254.324488:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+30:17478:x1875828747163776:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 Request processed in 813us (994us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1788930254.324496:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 46 00000100:00100000:0.0:1788930254.328011:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930254.328501:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747163904 00000100:00100000:2.0:1788930254.328511:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747163904 00000100:00100000:2.0:1788930254.328576:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 47 00000100:00100000:2.0:1788930254.328586:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+30:17478:x1875828747163904:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788930254.328609:0:18962:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930254.328630:0:18962:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e6de lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402108a4 expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.328689:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e6de lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402108a4 expref: 31 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.328705:0:18962:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e6de lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402108a4 expref: 31 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.328725:0:18962:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2e8528dc00) 00010000:00010000:2.0:1788930254.328728:0:18962:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788930254.328732:0:18962:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8566fc00, rc 0) 00000100:00100000:2.0:1788930254.328823:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+31:17478:x1875828747163904:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 238us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930254.328829:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 47 00010000:00010000:1.0:1788930254.330038:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6d7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.330054:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6d7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.330062:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6d7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.330068:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8566e400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930254.330081:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6d7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.330103:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6d7 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.330118:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2e8528dc00) 00010000:00010000:1.0:1788930254.330121:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788930254.330126:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6d7 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.330133:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e400/0xce4472dd2237e6d7 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930254.332311:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930254.332380:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747164032 00000100:00100000:1.0:1788930254.332389:0:19646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747164032 00000100:00100000:1.0:1788930254.332460:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00100000:1.0:1788930254.332471:0:19646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+5:2361:x1875828747164032:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788930254.333032:0:19646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:2361:x1875828747164032:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 Request processed in 561us (729us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788930254.333040:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 12 00000100:00080000:0.0:1788930254.333513:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788930254.359790:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930254.359897:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747164288 00000100:00100000:1.0:1788930254.359913:0:18965:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747164288 00000100:00100000:1.0:1788930254.359993:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:1.0:1788930254.360003:0:18965:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+30:17478:x1875828747164288:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788930254.360308:0:18965:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+31:17478:x1875828747164288:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 Request processed in 306us (533us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1788930254.360316:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 9 00000100:00100000:2.0:1788930254.382294:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930254.382415:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747164544 00000100:00100000:3.0:1788930254.382427:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747164544 00000100:00100000:3.0:1788930254.382493:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 48 00000100:00100000:3.0:1788930254.382507:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87cce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+31:17478:x1875828747164544:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788930254.382687:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87cce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+31:17478:x1875828747164544:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 Request processed in 183us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930254.382696:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 48 00000100:00100000:0.0:1788930254.388176:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930254.388514:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747164672 00000100:00100000:2.0:1788930254.388540:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747164672 00000100:00100000:2.0:1788930254.388617:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 49 00000100:00100000:2.0:1788930254.388629:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+31:17478:x1875828747164672:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788930254.388657:0:18962:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930254.388683:0:18962:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f800/0xce4472dd2237e6e5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402108ab expref: -99 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.388777:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f400/0xce4472dd2237e6ec lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.388793:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f400/0xce4472dd2237e6ec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.390234:0:18962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f400/0xce4472dd2237e6ec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788930254.390286:0:18962:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788930254.390306:0:18962:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f400/0xce4472dd2237e6ec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.390339:0:18962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f800/0xce4472dd2237e6e5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402108ab expref: 33 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.390357:0:18962:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f400/0xce4472dd2237e6ec lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402108ab expref: 32 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.390390:0:18962:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2e8528dc00) 00010000:00010000:2.0:1788930254.390394:0:18962:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788930254.390398:0:18962:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8566f400, rc 0) 00000100:00100000:2.0:1788930254.390466:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+32:17478:x1875828747164672:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 1840us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930254.390474:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 49 00000100:00100000:0.0:1788930254.397647:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930254.397721:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747164800 00000100:00100000:2.0:1788930254.397731:0:19647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747164800 00000100:00100000:2.0:1788930254.397812:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:2.0:1788930254.397823:0:19647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:2362:x1875828747164800:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788930254.397841:0:19647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930254.397860:0:19647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e20775ab/0xce4472dd2237e6f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402108b2 expref: -99 pid: 19647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788930254.397888:0:19647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa0e8cd, blocks: 0x1 00010000:00010000:2.0:1788930254.398130:0:19647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=639s v=(0 0) 00010000:00010000:2.0:1788930254.398136:0:19647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930254.398148:0:19647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e20775ab/0xce4472dd2237e6f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b2 expref: 7 pid: 19647 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.398171:0:19647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e20775ab/0xce4472dd2237e6f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b2 expref: 7 pid: 19647 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.398185:0:19647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8566e200, rc 0) 00000100:00100000:2.0:1788930254.398385:0:19647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+7:2362:x1875828747164800:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 563us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930254.398393:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:0.0:1788930254.401709:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930254.401838:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747165056 00000100:00100000:3.0:1788930254.401849:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747165056 00000100:00100000:3.0:1788930254.401911:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 50 00000100:00100000:3.0:1788930254.401930:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+32:17478:x1875828747165056:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788930254.402045:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+32:17478:x1875828747165056:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 Request processed in 118us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930254.402053:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 50 00000100:00100000:0.0:1788930254.405187:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930254.405274:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747165184 00000100:00100000:3.0:1788930254.405284:0:18961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747165184 00000100:00100000:3.0:1788930254.405336:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 51 00000100:00100000:3.0:1788930254.405345:0:18961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+32:17478:x1875828747165184:12345-192.168.204.40@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788930254.472176:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901904 is committed 00000001:00080000:0.0:1788930254.472196:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901892 is committed 00000001:00080000:0.0:1788930254.472361:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901911 is committed 00000001:00080000:0.0:1788930254.472380:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000004:00080000:0.0:1788930254.472393:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788930254.472678:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788930254.472698:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770218880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788930254.472768:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930254.473146:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770218880 00000100:00100000:1.0:1788930254.473173:0:19646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770218880 00000100:00100000:1.0:1788930254.473257:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788930254.473266:0:19646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875828770218880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788930254.473438:0:19646:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788930254.473443:0:19646:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788930254.473445:0:19646:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788930254.473447:0:19646:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1788930253 -> 1788930253 00002000:00010000:1.0:1788930254.473450:0:19646:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788930254.473498:0:19646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875828770218880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 232us (729us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1788930254.473506:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1788930254.473662:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d2e9837f480/2, rc 0, transno 12884901891 00000100:00100000:1.0:1788930254.473668:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875828770218880:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1788930254.473726:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788930254.474142:0:18961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+14:17478:x1875828747165184:12345-192.168.204.40@tcp:44:lhsmtool_posix.0 Request processed in 68794us (68960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930254.474152:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 51 00000100:00100000:0.0:1788930254.477546:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930254.477619:0:19645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747165312 00000100:00100000:1.0:1788930254.477629:0:19645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747165312 00000100:00100000:1.0:1788930254.477693:0:19645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 15 00000100:00100000:1.0:1788930254.477705:0:19645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+7:2362:x1875828747165312:12345-192.168.204.40@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788930254.478040:0:19645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+7:2362:x1875828747165312:12345-192.168.204.40@tcp:16:lhsmtool_posix.0 Request processed in 336us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930254.478048:0:19645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 15 00000100:00100000:0.0:1788930254.480365:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930254.480455:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747165568 00000100:00100000:3.0:1788930254.480465:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747165568 00000100:00100000:3.0:1788930254.480606:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 52 00000100:00100000:3.0:1788930254.480616:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+14:17478:x1875828747165568:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788930254.480668:0:18963:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788930254.480695:0:18963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566f400/0xce4472dd2237e6ec lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402108ab expref: 14 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930254.480715:0:18963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2e8528dc00) 00010000:00010000:3.0:1788930254.480721:0:18963:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788930254.480751:0:18963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e6fa lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930254.480765:0:18963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e6fa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930254.480775:0:18963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e6fa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788930254.481090:0:18963:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffd800ad reply state 00000000d2b7e532 transno 12884901912 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e6fa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930254.481113:0:18963:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788930254.481209:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+15:17478:x1875828747165568:12345-192.168.204.40@tcp:36:lhsmtool_posix.0 Request processed in 595us (854us total) trans 12884901912 rc 0/0 00000100:00100000:3.0:1788930254.481217:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 52 00000100:00100000:0.0:1788930254.483986:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930254.484156:0:20132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747165696 00000100:00100000:2.0:1788930254.484166:0:20132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747165696 00000100:00100000:2.0:1788930254.484217:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 16 00000100:00100000:2.0:1788930254.484245:0:20132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+7:17478:x1875828747165696:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788930254.484263:0:20132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788930254.484282:0:20132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5eb41a8/0xce4472dd2237e701 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa85ca716402108b9 expref: -99 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.484312:0:20132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e20775ab/0xce4472dd2237e6f3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b2 expref: 8 pid: 19647 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.484321:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930254.484325:0:20132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930254.484330:0:20132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eb41a8/0xce4472dd2237e701 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b9 expref: 8 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.484363:0:20132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e20775ab/0xce4472dd2237e6f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b2 expref: 8 pid: 19647 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.484377:0:20132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e20775ab/0xce4472dd2237e6f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b2 expref: 8 pid: 19647 timeout: 739 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930254.484407:0:20132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87ccd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:20132:1875828770219008:192.168.204.40@tcp:104: 00000100:00100000:2.0:1788930254.484487:0:20132:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d22f00 going to sleep for 11 seconds 00010000:00010000:3.0:1788930254.486912:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e6fa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930254.486930:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e6fa lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930254.486938:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e6fa lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930254.486945:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788930254.486951:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e6fa lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930254.486969:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e6fa lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930254.486990:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2e8528dc00) 00010000:00010000:3.0:1788930254.486993:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788930254.486999:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e6fa lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930254.487005:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2ebc596800/0xce4472dd2237e6fa lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930254.487408:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930254.487748:0:18947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747165824 00000100:00100000:1.0:1788930254.487757:0:18947:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747165824 00010000:00010000:1.0:1788930254.487795:0:18947:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e20775ab/0xce4472dd2237e6f3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b2 expref: 9 pid: 19647 timeout: 739 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930254.487843:0:18947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:1.0:1788930254.487854:0:18947:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+9:2362:x1875828747165824:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788930254.487903:0:18947:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788930254.487943:0:18947:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e20775ab/0xce4472dd2237e6f3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b2 expref: 9 pid: 19647 timeout: 739 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.487956:0:18947:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e20775ab/0xce4472dd2237e6f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b2 expref: 9 pid: 19647 timeout: 739 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.487977:0:18947:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930254.487981:0:18947:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930254.487988:0:18947:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5eb41a8/0xce4472dd2237e701 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b9 expref: 9 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.487998:0:18947:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eb41a8/0xce4472dd2237e701 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b9 expref: 9 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.488041:0:18947:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e5eb41a8/0xce4472dd2237e701 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b9 expref: 9 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930254.488058:0:18947:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:18947:1875828770219136:192.168.204.40@tcp:105: 00000100:00100000:1.0:1788930254.488144:0:18947:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e90a89600 going to sleep for 11 seconds 00000100:00100000:1.0:1788930254.490332:0:18947:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:18947:1875828770219136:192.168.204.40@tcp:105: 00010000:00010000:1.0:1788930254.490356:0:18947:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788930254.490407:0:18947:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+9:2362:x1875828747165824:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 2554us (3002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930254.490418:0:18947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 13 00010000:00010000:2.0:1788930254.491424:0:20132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e20775ab/0xce4472dd2237e6f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b2 expref: 8 pid: 19647 timeout: 739 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930254.491444:0:20132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87ccd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:20132:1875828770219008:192.168.204.40@tcp:104: 00010000:00010000:2.0:1788930254.491466:0:20132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e5eb41a8/0xce4472dd2237e701 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b9 expref: 7 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.491479:0:20132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d2d8566f800, rc 0) 00000100:00100000:2.0:1788930254.491606:0:20132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+7:17478:x1875828747165696:12345-192.168.204.40@tcp:101:lhsmtool_posix.0 Request processed in 7379us (7627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930254.491615:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 16 00000100:00100000:0.0:1788930254.497187:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930254.497279:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747165952 00000100:00100000:2.0:1788930254.497288:0:19647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747165952 00000100:00100000:2.0:1788930254.497348:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 17 00000100:00100000:2.0:1788930254.497360:0:19647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+7:2361:x1875828747165952:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788930254.497790:0:19647:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788930254.497794:0:19647:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1788930252 00002000:00010000:2.0:1788930254.497971:0:19647:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 0 -> 1788930251 00002000:00010000:2.0:1788930254.497974:0:19647:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1788930253 -> 1788930252 00002000:00010000:2.0:1788930254.497976:0:19647:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788930254.498087:0:19647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+8:2361:x1875828747165952:12345-192.168.204.40@tcp:2:lhsmtool_posix.0 Request processed in 728us (912us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788930254.498109:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 17 00000100:00100000:0.0:1788930254.500989:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930254.501085:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747166080 00000100:00100000:1.0:1788930254.501095:0:19646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747166080 00000100:00100000:1.0:1788930254.501178:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:1.0:1788930254.501188:0:19646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+8:2362:x1875828747166080:12345-192.168.204.40@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788930254.501254:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e708 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.501274:0:19646:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5eb41a8/0xce4472dd2237e701 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b9 expref: 8 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.501282:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930254.501286:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788930254.501291:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e708 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.501323:0:19646:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e5eb41a8/0xce4472dd2237e701 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b9 expref: 8 pid: 20132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.501337:0:19646:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e5eb41a8/0xce4472dd2237e701 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b9 expref: 8 pid: 20132 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930254.501352:0:19646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:19646:1875828770219264:192.168.204.40@tcp:104: 00000100:00100000:1.0:1788930254.501425:0:19646:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e90a89600 going to sleep for 11 seconds 00000100:00100000:0.0:1788930254.506608:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930254.507950:0:19646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:19646:1875828770219264:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788930254.507984:0:19646:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e708 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930254.508173:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747166208 00000100:00100000:3.0:1788930254.508182:0:18946:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747166208 00010000:00010000:3.0:1788930254.508254:0:18946:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eb41a8/0xce4472dd2237e701 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b9 expref: 9 pid: 20132 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930254.508287:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:3.0:1788930254.508296:0:18946:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+9:2362:x1875828747166208:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788930254.508312:0:18946:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788930254.508334:0:18946:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e5eb41a8/0xce4472dd2237e701 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b9 expref: 9 pid: 20132 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930254.508347:0:18946:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e5eb41a8/0xce4472dd2237e701 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b9 expref: 9 pid: 20132 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930254.508368:0:18946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5eb41a8/0xce4472dd2237e701 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.40@tcp remote: 0xa85ca716402108b9 expref: 9 pid: 20132 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930254.508383:0:18946:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788930254.508387:0:18946:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788930254.508392:0:18946:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e708 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930254.508402:0:18946:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e708 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930254.508431:0:18946:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788930254.508496:0:18946:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+8:2362:x1875828747166208:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 201us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930254.508513:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 14 00010000:00010000:1.0:1788930254.508715:0:19646:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e708 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.508725:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e708 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.508752:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e708 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.508761:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e708 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.508768:0:19646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e708 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.508775:0:19646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74a00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930254.508779:0:19646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e708 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.508788:0:19646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e708 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.508799:0:19646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e708 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.508817:0:19646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e708 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930254.508860:0:19646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+8:2362:x1875828747166080:12345-192.168.204.40@tcp:1:lhsmtool_posix.0 Request processed in 7674us (7879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930254.508868:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 18 00000100:00100000:0.0:1788930254.512536:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930254.512621:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747166464 00000100:00100000:2.0:1788930254.512630:0:18962:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747166464 00000100:00100000:2.0:1788930254.512691:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 53 00000100:00100000:2.0:1788930254.512702:0:18962:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+14:17478:x1875828747166464:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788930254.512781:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566ec00/0xce4472dd2237e70f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.512800:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566ec00/0xce4472dd2237e70f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.512812:0:18962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566ec00/0xce4472dd2237e70f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.513099:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fa00/0xce4472dd2237e716 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.513111:0:18962:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e6de lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca716402108a4 expref: 15 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.513120:0:18962:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fa00/0xce4472dd2237e716 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.513157:0:18962:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e6de lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402108a4 expref: 15 pid: 18962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.513172:0:18962:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e6de lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402108a4 expref: 15 pid: 18962 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930254.513198:0:18962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87ccd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18962:1875828770219392:192.168.204.40@tcp:104: 00000100:00100000:2.0:1788930254.513307:0:18962:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d22f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788930254.520913:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930254.521094:0:18948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747166592 00000100:00100000:3.0:1788930254.521105:0:18948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747166592 00010000:00010000:3.0:1788930254.521155:0:18948:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e6de lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402108a4 expref: 16 pid: 18962 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930254.521198:0:18948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 15 00000100:00100000:3.0:1788930254.521208:0:18948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+16:2361:x1875828747166592:12345-192.168.204.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788930254.521262:0:18948:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788930254.521270:0:18948:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e6de lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402108a4 expref: 16 pid: 18962 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930254.521285:0:18948:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e6de lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402108a4 expref: 16 pid: 18962 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930254.521307:0:18948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2e8528dc00) 00010000:00010000:3.0:1788930254.521312:0:18948:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fa00/0xce4472dd2237e716 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930254.521322:0:18948:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fa00/0xce4472dd2237e716 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930254.521330:0:18948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fa00/0xce4472dd2237e716 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930254.521348:0:18948:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788930254.521398:0:18948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+16:2361:x1875828747166592:12345-192.168.204.40@tcp:103:ldlm_bl.0 Request processed in 192us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930254.521423:0:18948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 15 00010000:00010000:1.0:1788930254.521531:0:18962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fc00/0xce4472dd2237e6de lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.40@tcp remote: 0xa85ca716402108a4 expref: 15 pid: 18962 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930254.521550:0:18962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87ccd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18962:1875828770219392:192.168.204.40@tcp:104: 00010000:00010000:1.0:1788930254.521576:0:18962:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fa00/0xce4472dd2237e716 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.521585:0:18962:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fa00/0xce4472dd2237e716 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.521590:0:18962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fa00/0xce4472dd2237e716 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788930254.521808:0:18962:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:1.0:1788930254.521967:0:18962:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000001:00080000:1.0:1788930254.522014:0:18962:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1788930254.522108:0:18962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18962:1875828770219520:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788930254.522216:0:18962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930254.522303:0:18962:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e8b7246c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788930254.522573:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770219520 00000100:00100000:3.0:1788930254.522579:0:18966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770219520 00000100:00100000:3.0:1788930254.522620:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788930254.522628:0:18966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18962:x1875828770219520:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788930254.522700:0:18966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18962:x1875828770219520:12345-0@lo:1000:mdt00_001.0 Request processed in 73us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930254.522707:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788930254.523741:0:18962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18962:1875828770219520:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788930254.525612:0:18962:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901916 00000100:00100000:1.0:1788930254.525727:0:18962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e9837e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18962:1875828770219648:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788930254.525832:0:18962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930254.526065:0:18962:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e90a89600 going to sleep for 11 seconds 00000100:00100000:3.0:1788930254.526671:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770219648 00000100:00100000:3.0:1788930254.526681:0:18966:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770219648 00000100:00100000:3.0:1788930254.526766:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788930254.526777:0:18966:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18962:x1875828770219648:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788930254.527220:0:18966:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:18962:x1875828770219648:12345-0@lo:1000:mdt00_001.0 Request processed in 443us (1387us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788930254.527245:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788930254.527337:0:18962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e9837e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18962:1875828770219648:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788930254.527378:0:18962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fa00/0xce4472dd2237e716 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.527389:0:18962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fa00/0xce4472dd2237e716 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.527397:0:18962:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fa00/0xce4472dd2237e716 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.527404:0:18962:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8566fa00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930254.527409:0:18962:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fa00/0xce4472dd2237e716 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.527417:0:18962:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fa00/0xce4472dd2237e716 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.527435:0:18962:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2e8528dc00) 00010000:00010000:2.0:1788930254.527438:0:18962:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788930254.527443:0:18962:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fa00/0xce4472dd2237e716 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.527449:0:18962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566fa00/0xce4472dd2237e716 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.527480:0:18962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e000/0xce4472dd2237e66e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.527501:0:18962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e000/0xce4472dd2237e66e lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.527507:0:18962:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e000/0xce4472dd2237e66e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.527512:0:18962:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8566e000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788930254.527514:0:18962:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e000/0xce4472dd2237e66e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.527532:0:18962:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e000/0xce4472dd2237e66e lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.527541:0:18962:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d2e8528da00) 00010000:00010000:2.0:1788930254.527543:0:18962:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788930254.527550:0:18962:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e675 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210888 expref: 18 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.527562:0:18962:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e675 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210888 expref: 18 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.527571:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e675 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210888 expref: 18 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.527629:0:18962:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a75a00/0xce4472dd2237e675 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.40@tcp remote: 0xa85ca71640210888 expref: 18 pid: 20889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930254.527643:0:18962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87ccce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18962:1875828770219776:192.168.204.40@tcp:105: 00000100:00100000:2.0:1788930254.527731:0:18962:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d2e87d22900 going to sleep for 11 seconds 00000100:00100000:1.0:1788930254.531262:0:18962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87ccce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18962:1875828770219776:192.168.204.40@tcp:105: 00010000:00010000:1.0:1788930254.531297:0:18962:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e000/0xce4472dd2237e66e lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.531309:0:18962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566e000/0xce4472dd2237e66e lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.531342:0:18962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e71d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.531356:0:18962:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e71d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.531368:0:18962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e71d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.531380:0:18962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e71d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.531387:0:18962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e71d lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.531392:0:18962:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e71d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.531397:0:18962:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930254.531401:0:18962:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e71d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.531422:0:18962:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e71d lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.531434:0:18962:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d2e8528da00) 00010000:00010000:1.0:1788930254.531437:0:18962:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788930254.531442:0:18962:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e71d lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.531447:0:18962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74a00/0xce4472dd2237e71d lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.531457:0:18962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566ec00/0xce4472dd2237e70f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.531463:0:18962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566ec00/0xce4472dd2237e70f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.531469:0:18962:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566ec00/0xce4472dd2237e70f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.531473:0:18962:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8566ec00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788930254.531476:0:18962:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566ec00/0xce4472dd2237e70f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.531482:0:18962:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566ec00/0xce4472dd2237e70f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.531489:0:18962:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d2e8528da00) 00010000:00010000:1.0:1788930254.531491:0:18962:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788930254.531494:0:18962:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566ec00/0xce4472dd2237e70f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.531510:0:18962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d8566ec00/0xce4472dd2237e70f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18962 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930254.531740:0:18962:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+18:17478:x1875828747166464:12345-192.168.204.40@tcp:57:lhsmtool_posix.0 Request processed in 19038us (19224us total) trans 12884901917 rc 0/0 00000100:00100000:1.0:1788930254.531751:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 53 00000020:00080000:1.0:1788930254.531757:0:18962:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788930254.531986:0:18994:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788930254.531991:0:18994:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788930254.532015:0:18994:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788930254.532020:0:18994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788930254.535482:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930254.535594:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747166848 00000100:00100000:1.0:1788930254.535605:0:18965:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747166848 00000100:00100000:0.0:1788930254.535703:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930254.535828:0:18965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747166976 00000100:00100000:1.0:1788930254.535833:0:18965:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747166976 00000100:00100000:1.0:1788930254.535865:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 10 00000100:00100000:1.0:1788930254.535874:0:18965:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e86317450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+19:17478:x1875828747166848:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788930254.536776:0:18965:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788930254.537053:0:18965:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901918 00010000:00010000:1.0:1788930254.537117:0:18965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e724 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.537135:0:18965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e724 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.537149:0:18965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e724 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.537158:0:18965:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e724 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.537165:0:18965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e724 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.537185:0:18965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e724 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.537284:0:18965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788930254.537457:0:18965:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e86317450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+21:17478:x1875828747166848:12345-192.168.204.40@tcp:35:lhsmtool_posix.0 Request processed in 1580us (1980us total) trans 12884901919 rc 0/0 00000100:00100000:1.0:1788930254.537466:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 10 00000020:00080000:1.0:1788930254.537472:0:18965:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788930254.537529:0:18965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 11 00000100:00100000:1.0:1788930254.537539:0:18965:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+20:17477:x1875828747166976:12345-192.168.204.40@tcp:49:dd.0 00000100:00100000:1.0:1788930254.537609:0:18965:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+20:17477:x1875828747166976:12345-192.168.204.40@tcp:49:dd.0 Request processed in 72us (1906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930254.537616:0:18965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 11 00010000:00010000:0.0:1788930254.537778:0:18949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788930254.537793:0:18949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e724 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930254.537812:0:18949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74400 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930254.537816:0:18949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e724 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930254.537825:0:18949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e724 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930254.537838:0:18949:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d2e8528dc00) 00010000:00010000:0.0:1788930254.537848:0:18949:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788930254.537854:0:18949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e724 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930254.537860:0:18949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d2d86a74400/0xce4472dd2237e724 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930254.537873:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930254.537875:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788930254.537877:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930254.684052:0:21073:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788930254.696648:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930254.696695:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930254.696728:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930254.696751:0:19650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747167232 00000100:00100000:0.0:1788930254.696756:0:19652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747167360 00000100:00100000:1.0:1788930254.696761:0:19650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747167232 00000100:00100000:0.0:1788930254.696761:0:19652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747167360 00000100:00100000:0.0:1788930254.696810:0:19652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747167104 00000100:00100000:0.0:1788930254.696814:0:19652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747167104 00000100:00100000:2.0:1788930254.696868:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:2.0:1788930254.696884:0:19651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+9:2361:x1875828747167360:12345-192.168.204.40@tcp:4:dd.0 00002000:00010000:2.0:1788930254.696947:0:19651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 0, mtime: 0x6aa0e8cc, atime: 0x6aa0e8cb, ctime: 0x6aa0e8cc, blocks: 0x1 00010000:00010000:2.0:1788930254.696957:0:19651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093ffe14e/0xce4472dd2237e72b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.696973:0:19651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=639s v=(0 0) 00010000:00010000:2.0:1788930254.696978:0:19651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930254.696985:0:19651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093ffe14e/0xce4472dd2237e72b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930254.697004:0:19651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093ffe14e/0xce4472dd2237e72b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788930254.804762:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00000001:00080000:1.0:1788930254.804797:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901891 is committed 00000001:00080000:1.0:1788930254.804809:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901893 is committed 00002000:00010000:1.0:1788930254.816006:0:19651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:1.0:1788930254.816017:0:19651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 1788930252 -> 1788930253 00002000:00010000:1.0:1788930254.816021:0:19651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:1.0:1788930254.816039:0:19651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093ffe14e/0xce4472dd2237e72b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.816053:0:19651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093ffe14e/0xce4472dd2237e72b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.816095:0:19651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093ffe14e/0xce4472dd2237e72b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.816103:0:19651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8566fa00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930254.816178:0:19651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093ffe14e/0xce4472dd2237e72b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.816190:0:19651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093ffe14e/0xce4472dd2237e72b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.816210:0:19651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093ffe14e/0xce4472dd2237e72b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.816219:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093ffe14e/0xce4472dd2237e72b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930254.816408:0:19651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+7:2361:x1875828747167360:12345-192.168.204.40@tcp:4:dd.0 Request processed in 119523us (119706us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1788930254.816418:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 0 00000100:00100000:1.0:1788930254.816456:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 1 00000100:00100000:1.0:1788930254.816469:0:19651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+6:2361:x1875828747167232:12345-192.168.204.40@tcp:4:dd.0 00002000:00010000:1.0:1788930254.816534:0:19651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 3145728, mtime: 0x6aa0e8cd, atime: 0x6aa0e8cb, ctime: 0x0, blocks: 0x807 00010000:00010000:1.0:1788930254.816541:0:19651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e732 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.816565:0:19651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=639s v=(0 0) 00010000:00010000:1.0:1788930254.816569:0:19651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930254.816576:0:19651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e732 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930254.816588:0:19651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e732 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788930254.834398:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930254.835256:0:19652:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788930254.835271:0:19652:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788930254.839364:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930254.839417:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930254.840688:0:19652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747167488 00000100:00100000:2.0:1788930254.840700:0:19652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747167488 00000100:00100000:2.0:1788930254.840765:0:19652:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788930254.840774:0:19652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747167616 00000100:00100000:2.0:1788930254.840777:0:19652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747167616 00000100:00100000:2.0:1788930254.840793:0:19652:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788930254.840798:0:19652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747167744 00000100:00100000:2.0:1788930254.840802:0:19652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747167744 00000100:00100000:0.0:1788930254.841476:0:21093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:0.0:1788930254.841489:0:21093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+10:2360:x1875828747167104:12345-192.168.204.40@tcp:4:dd.0 00010000:00010000:0.0:1788930254.841973:0:21093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a77356/0xce4472dd2237e739 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930254.841993:0:21093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930254.841998:0:21093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930254.842004:0:21093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a77356/0xce4472dd2237e739 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930254.842020:0:21093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011a77356/0xce4472dd2237e739 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788930254.933872:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00002000:00010000:0.0:1788930254.933968:0:19651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:0.0:1788930254.933986:0:19651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e732 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930254.933999:0:19651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e732 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930254.934009:0:19651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e732 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930254.934016:0:19651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74a00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930254.934021:0:19651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e732 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930254.934030:0:19651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e732 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930254.934080:0:19651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e732 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930254.934089:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fae8d970/0xce4472dd2237e732 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930254.934184:0:19651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+12:2361:x1875828747167232:12345-192.168.204.40@tcp:4:dd.0 Request processed in 117716us (237542us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788930254.934195:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 1 00000100:00100000:0.0:1788930254.934262:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:0.0:1788930254.934275:0:19651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+11:2359:x1875828747167488:12345-192.168.204.40@tcp:4:dd.0 00010000:00010000:0.0:1788930254.934307:0:19651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076fb7ebf/0xce4472dd2237e740 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930254.934319:0:19651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788930254.934337:0:19651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930254.934344:0:19651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076fb7ebf/0xce4472dd2237e740 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930254.934363:0:19651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076fb7ebf/0xce4472dd2237e740 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788930255.007759:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:2.0:1788930255.014686:0:21093:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:2.0:1788930255.014694:0:21093:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:2.0:1788930255.014710:0:21093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a77356/0xce4472dd2237e739 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930255.014741:0:21093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011a77356/0xce4472dd2237e739 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930255.014750:0:21093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011a77356/0xce4472dd2237e739 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930255.014757:0:21093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930255.014762:0:21093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a77356/0xce4472dd2237e739 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930255.014772:0:21093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a77356/0xce4472dd2237e739 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930255.014793:0:21093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011a77356/0xce4472dd2237e739 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930255.014800:0:21093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011a77356/0xce4472dd2237e739 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930255.014900:0:21093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+11:2360:x1875828747167104:12345-192.168.204.40@tcp:4:dd.0 Request processed in 173409us (318166us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788930255.014909:0:21093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 2 00000100:00100000:2.0:1788930255.014942:0:21093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:2.0:1788930255.014955:0:21093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90316d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+10:2360:x1875828747167616:12345-192.168.204.40@tcp:4:dd.0 00010000:00010000:2.0:1788930255.014986:0:21093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b33f0a9/0xce4472dd2237e747 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930255.015003:0:21093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930255.015007:0:21093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788930255.015013:0:21093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b33f0a9/0xce4472dd2237e747 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930255.015025:0:21093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b33f0a9/0xce4472dd2237e747 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788930255.051212:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901897 is committed 00002000:00010000:0.0:1788930255.052057:0:19651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 4194304 -> 6291456 00010000:00010000:0.0:1788930255.052089:0:19651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076fb7ebf/0xce4472dd2237e740 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930255.052117:0:19651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076fb7ebf/0xce4472dd2237e740 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930255.052127:0:19651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076fb7ebf/0xce4472dd2237e740 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930255.052134:0:19651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8200 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:0.0:1788930255.052139:0:19651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076fb7ebf/0xce4472dd2237e740 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930255.052149:0:19651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076fb7ebf/0xce4472dd2237e740 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930255.052173:0:19651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076fb7ebf/0xce4472dd2237e740 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930255.052181:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076fb7ebf/0xce4472dd2237e740 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788930255.052343:0:19651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+10:2359:x1875828747167488:12345-192.168.204.40@tcp:4:dd.0 Request processed in 118063us (217947us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1788930255.052355:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 3 00000100:00100000:0.0:1788930255.052399:0:19651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 5 00000100:00100000:0.0:1788930255.052416:0:19651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+9:2360:x1875828747167744:12345-192.168.204.40@tcp:4:dd.0 00010000:00010000:0.0:1788930255.052459:0:19651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a77356/0xce4472dd2237e74e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930255.052480:0:19651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930255.052486:0:19651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788930255.052494:0:19651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a77356/0xce4472dd2237e74e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788930255.052509:0:19651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011a77356/0xce4472dd2237e74e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788930255.098865:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901898 is committed 00002000:00010000:1.0:1788930255.102257:0:21093:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:1.0:1788930255.102280:0:21093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b33f0a9/0xce4472dd2237e747 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930255.102293:0:21093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b33f0a9/0xce4472dd2237e747 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930255.102302:0:21093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b33f0a9/0xce4472dd2237e747 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930255.102309:0:21093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d8566fc00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930255.102314:0:21093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b33f0a9/0xce4472dd2237e747 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930255.102323:0:21093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b33f0a9/0xce4472dd2237e747 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930255.102364:0:21093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b33f0a9/0xce4472dd2237e747 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930255.102371:0:21093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b33f0a9/0xce4472dd2237e747 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930255.102472:0:21093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90316d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f6beff19-9e3f-4b9a-94ae-af74e13e7978+9:2360:x1875828747167616:12345-192.168.204.40@tcp:4:dd.0 Request processed in 87516us (263111us total) trans 12884901898 rc 0/0 00000100:00100000:1.0:1788930255.102483:0:21093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 4 00000100:00100000:2.0:1788930255.109939:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930255.110056:0:19652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747167872 00000100:00100000:1.0:1788930255.110075:0:19652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747167872 00000100:00100000:1.0:1788930255.110148:0:19652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 6 00000100:00100000:1.0:1788930255.110157:0:19652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+9:2361:x1875828747167872:12345-192.168.204.40@tcp:4:dd.0 00010000:00010000:1.0:1788930255.110188:0:19652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d8ff666/0xce4472dd2237e755 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930255.110206:0:19652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930255.110210:0:19652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788930255.110216:0:19652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d8ff666/0xce4472dd2237e755 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930255.110253:0:19652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d8ff666/0xce4472dd2237e755 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930255.115374:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:0.0:1788930255.116699:0:21093:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788930255.116714:0:21093:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1788930255.117566:0:21093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747168000 00000100:00100000:3.0:1788930255.117581:0:21093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747168000 00000100:00100000:3.0:1788930255.118112:0:21094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 7 00000100:00100000:3.0:1788930255.118125:0:21094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2d86d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f6beff19-9e3f-4b9a-94ae-af74e13e7978+11:2361:x1875828747168000:12345-192.168.204.40@tcp:4:dd.0 00010000:00010000:3.0:1788930255.118169:0:21094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000343707be/0xce4472dd2237e75c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930255.118187:0:21094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930255.118191:0:21094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788930255.118198:0:21094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000343707be/0xce4472dd2237e75c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788930255.118213:0:21094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000343707be/0xce4472dd2237e75c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788930255.158469:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901899 is committed 00002000:00010000:1.0:1788930255.160447:0:19651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:1.0:1788930255.160458:0:19651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 0 -> 1788930253 00002000:00010000:1.0:1788930255.160461:0:19651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1788930255.160479:0:19651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a77356/0xce4472dd2237e74e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930255.160495:0:19651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011a77356/0xce4472dd2237e74e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930255.160517:0:19651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011a77356/0xce4472dd2237e74e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930255.160526:0:19651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebe0b8800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930255.160532:0:19651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a77356/0xce4472dd2237e74e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930255.160543:0:19651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a77356/0xce4472dd2237e74e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930255.160568:0:19651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011a77356/0xce4472dd2237e74e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930255.160576:0:19651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011a77356/0xce4472dd2237e74e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930255.160679:0:19651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f6beff19-9e3f-4b9a-94ae-af74e13e7978+13:2360:x1875828747167744:12345-192.168.204.40@tcp:4:dd.0 Request processed in 108266us (321258us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1788930255.160701:0:19651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 5 00002000:00010000:2.0:1788930255.199543:0:21094:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1788930255.199568:0:21094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000343707be/0xce4472dd2237e75c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930255.199582:0:21094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000343707be/0xce4472dd2237e75c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930255.199592:0:21094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000343707be/0xce4472dd2237e75c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930255.199599:0:21094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2ebc596800 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:2.0:1788930255.199604:0:21094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000343707be/0xce4472dd2237e75c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930255.199614:0:21094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000343707be/0xce4472dd2237e75c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930255.199652:0:21094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000343707be/0xce4472dd2237e75c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788930255.199661:0:21094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000343707be/0xce4472dd2237e75c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788930255.199772:0:21094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2d86d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f6beff19-9e3f-4b9a-94ae-af74e13e7978+11:2361:x1875828747168000:12345-192.168.204.40@tcp:4:dd.0 Request processed in 81645us (84402us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1788930255.199782:0:21094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 7 00000001:00080000:2.0:1788930255.199827:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901901 is committed 00010000:00010000:1.0:1788930255.201527:0:19652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d8ff666/0xce4472dd2237e755 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930255.201546:0:19652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d8ff666/0xce4472dd2237e755 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930255.201555:0:19652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d8ff666/0xce4472dd2237e755 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930255.201562:0:19652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d2d86a74e00 already unused, calling callback (ffffffffc16f08b0) 00010000:00010000:1.0:1788930255.201566:0:19652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d8ff666/0xce4472dd2237e755 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930255.201576:0:19652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d8ff666/0xce4472dd2237e755 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930255.201597:0:19652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d8ff666/0xce4472dd2237e755 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788930255.201606:0:19652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d8ff666/0xce4472dd2237e755 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788930255.201751:0:19652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f6beff19-9e3f-4b9a-94ae-af74e13e7978+5:2361:x1875828747167872:12345-192.168.204.40@tcp:4:dd.0 Request processed in 91590us (91816us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1788930255.201762:0:19652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 6 00000040:00080000:3.0:1788930255.579675:0:18994:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788930255.579687:0:18994:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788930255.579719:0:18994:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788930255.579726:0:18994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788930255.707719:0:18950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788930255.835289:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930255.835324:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930255.835361:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:3.0:1788930255.835388:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:1.0:1788930255.836018:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747168128 00000100:00100000:1.0:1788930255.836038:0:18955:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747168128 00000100:00100000:1.0:1788930255.836131:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 121 00000100:00100000:1.0:1788930255.836145:0:18955:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+13:2361:x1875828747168128:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930255.836206:0:19645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747168384 00000100:00100000:2.0:1788930255.836213:0:19645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747168384 00000100:00100000:1.0:1788930255.836273:0:18955:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54fa4f43-feb8-4641-8502-e0f8083e1215+13:2361:x1875828747168128:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 131us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930255.836283:0:19645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747168896 00000100:00100000:1.0:1788930255.836283:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 121 00000100:00100000:2.0:1788930255.836288:0:19645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747168896 00000100:00100000:2.0:1788930255.836314:0:19645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:2.0:1788930255.836324:0:19645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+5:2361:x1875828747168384:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:1.0:1788930255.836328:0:20889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747168640 00000100:00100000:1.0:1788930255.836334:0:20889:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747168640 00000100:00100000:2.0:1788930255.836358:0:19645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+5:2361:x1875828747168384:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 37us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930255.836365:0:19645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 13 00000100:00100000:1.0:1788930255.836371:0:20889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 23 00000100:00100000:2.0:1788930255.836383:0:19645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00100000:2.0:1788930255.836391:0:19645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a847aba8-b811-46f0-8caf-0cdd775ee205+5:2361:x1875828747168896:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930255.836410:0:19645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a847aba8-b811-46f0-8caf-0cdd775ee205+5:2361:x1875828747168896:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 21us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930255.836416:0:19645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 14 00000100:00080000:2.0:1788930255.836443:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788930255.836443:0:20889:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a847aba8-b811-46f0-8caf-0cdd775ee205+6:2361:x1875828747168640:12345-192.168.204.40@tcp:400:kworker.0 00000100:00080000:2.0:1788930255.836449:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788930255.836452:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788930255.836548:0:20889:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a847aba8-b811-46f0-8caf-0cdd775ee205+6:2361:x1875828747168640:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 167us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930255.836557:0:20889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 23 00000100:00100000:2.0:1788930255.841856:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930255.842182:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747168256 00000100:00100000:2.0:1788930255.842192:0:18961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747168256 00000100:00100000:2.0:1788930255.842270:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 24 00000100:00100000:2.0:1788930255.842282:0:18961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+20:2362:x1875828747168256:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:3.0:1788930255.842319:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930255.842388:0:18961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+20:2362:x1875828747168256:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 108us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930255.842397:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 24 00000100:00100000:2.0:1788930255.842535:0:19645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747168512 00000100:00100000:2.0:1788930255.842540:0:19645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747168512 00000100:00100000:2.0:1788930255.842567:0:19645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 15 00000100:00100000:2.0:1788930255.842573:0:19645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e90316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+5:2362:x1875828747168512:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930255.843831:0:19645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e90316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f6beff19-9e3f-4b9a-94ae-af74e13e7978+5:2362:x1875828747168512:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 1251us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930255.843841:0:19645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 15 00000100:00100000:3.0:1788930255.843968:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.40@tcp (source: 12345-192.168.204.40@tcp) 00000100:00100000:2.0:1788930255.844000:0:20132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828747168768 00000100:00100000:2.0:1788930255.844007:0:20132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828747168768 00000100:00100000:2.0:1788930255.844059:0:20132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.40@tcp, seq: 16 00000100:00100000:2.0:1788930255.844068:0:20132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2eb5a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a847aba8-b811-46f0-8caf-0cdd775ee205+5:2362:x1875828747168768:12345-192.168.204.40@tcp:400:kworker.0 00000100:00100000:2.0:1788930255.844110:0:20132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2eb5a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a847aba8-b811-46f0-8caf-0cdd775ee205+5:2362:x1875828747168768:12345-192.168.204.40@tcp:400:kworker.0 Request processed in 43us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930255.844117:0:20132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.40@tcp, seq: 16 00000100:00080000:3.0:1788930255.845008:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788930256.368377:0:21132:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788930256.731999:0:18949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788930257.755392:0:21073:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788930257.885541:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788930257.885562:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e87ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770219904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788930257.885630:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930257.885706:0:19649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770219904 00000100:00100000:2.0:1788930257.885714:0:19649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770219904 00000100:00100000:2.0:1788930257.885766:0:19649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788930257.885776:0:19649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770219904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788930257.885811:0:19649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 64684032 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788930257.885858:0:19649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875828770219904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930257.885865:0:19649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788930257.885886:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788930257.885910:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901893 gen 2 00000004:00080000:2.0:1788930257.885915:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d2e9837f480, transno 12884901891 00000004:00080000:2.0:1788930257.885922:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901893 committed transno 12884901893 00000100:00100000:2.0:1788930257.885952:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e87ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875828770219904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788930257.890951:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770220288:0@lo:400:kworker.0 00000100:00100000:0.0:1788930257.891042:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788930257.891083:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788930257.891089:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770220416:0@lo:400:kworker.0 00000100:00100000:2.0:1788930257.891213:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e88018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770220160:0@lo:400:kworker.0 00000100:00100000:2.0:1788930257.891278:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930257.891299:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788930257.891305:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8801a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c52ce1e4-e465-4485-9875-0a24e445f9ec:3311:1875828770220032:0@lo:400:kworker.0 00000100:00100000:2.0:1788930257.891333:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930257.891358:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d2e8801b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875828770220544:0@lo:400:kworker.0 00000100:00100000:2.0:1788930257.891392:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770220160 00000100:00100000:2.0:1788930257.891399:0:19647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770220160 00000100:00100000:2.0:1788930257.891448:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788930257.891456:0:19647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e87ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770220160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788930257.891521:0:19647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e87ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875828770220160:12345-0@lo:400:kworker.0 Request processed in 65us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788930257.891528:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788930257.891549:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788930257.891765:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788930257.891866:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788930257.893039:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770220032 00000100:00100000:1.0:1788930257.893051:0:18954:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770220032 00000100:00100000:1.0:1788930257.893097:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788930257.893106:0:18954:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e84577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:3311:x1875828770220032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788930257.893170:0:18954:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e84577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c52ce1e4-e465-4485-9875-0a24e445f9ec+19:3311:x1875828770220032:12345-0@lo:400:kworker.0 Request processed in 65us (1836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788930257.893176:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788930257.895960:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875828770220160:0@lo:400:kworker.0 00000100:00100000:2.0:1788930257.896015:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8801a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c52ce1e4-e465-4485-9875-0a24e445f9ec:3311:1875828770220032:0@lo:400:kworker.0 00000100:00100000:3.0:1788930257.899621:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770220288 00000100:00100000:3.0:1788930257.899639:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770220288 00000100:00100000:3.0:1788930257.899725:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770220416 00000100:00100000:3.0:1788930257.899729:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770220416 00000100:00100000:3.0:1788930257.899756:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875828770220544 00000100:00100000:3.0:1788930257.899759:0:18963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875828770220544 00000100:00100000:3.0:1788930257.899782:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788930257.899802:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e8801b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770220288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930257.899911:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e8801b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875828770220288:12345-0@lo:400:kworker.0 Request processed in 111us (8869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930257.899919:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788930257.899936:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788930257.899942:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e88019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770220416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930257.899972:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e88019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875828770220416:12345-0@lo:400:kworker.0 Request processed in 31us (8208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930257.899979:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788930257.899991:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788930257.899997:0:18963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d2e9837f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875828770220544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788930257.900042:0:18963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d2e9837f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875828770220544:12345-0@lo:400:kworker.0 Request processed in 45us (8176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788930257.900048:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788930257.900075:0:18957:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788930257.900304:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875828770220416:0@lo:400:kworker.0 00000100:00100000:3.0:1788930257.900322:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e88019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875828770220288:0@lo:400:kworker.0 00000100:00100000:3.0:1788930257.900361:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d2e8801b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875828770220544:0@lo:400:kworker.0 Debug log: 9696 lines, 9696 kept, 0 dropped, 0 bad.