00010000:00010000:3.0F:1788869723.720319:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869724.616722:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869724.617905:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869724.617939:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869724.617968:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869724.618011:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305163904 00000100:00100000:3.0:1788869724.618023:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305163904 00000100:00100000:3.0:1788869724.618085:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305163776 00000100:00100000:3.0:1788869724.618088:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305163776 00000100:00100000:3.0:1788869724.618112:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:3.0:1788869724.618123:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+5:2409:x1875765305163904:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869724.618213:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+5:2409:x1875765305163904:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 92us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869724.618221:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:3.0:1788869724.618239:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:3.0:1788869724.618246:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+26:2409:x1875765305163776:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869724.618277:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+26:2409:x1875765305163776:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 31us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869724.618284:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:3.0:1788869724.618304:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305164032 00000100:00100000:3.0:1788869724.618308:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305164032 00000100:00100000:3.0:1788869724.618335:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:3.0:1788869724.618342:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:893992aa-f001-4ff6-aa93-863511511bbf+10:2409:x1875765305164032:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869724.618366:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:893992aa-f001-4ff6-aa93-863511511bbf+10:2409:x1875765305164032:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869724.618373:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00080000:3.0:1788869724.618388:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869724.618402:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869724.618405:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0F:1788869724.618905:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305163648 00000100:00100000:2.0:1788869724.618917:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305163648 00000100:00100000:2.0:1788869724.618948:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 170 00000100:00100000:2.0:1788869724.618954:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+13:2409:x1875765305163648:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869724.618982:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+13:2409:x1875765305163648:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 29us (2274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869724.618988:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 170 00000100:00100000:0.0F:1788869724.627683:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869724.627743:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869724.627770:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869724.627772:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305164160 00000100:00100000:3.0:1788869724.627782:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305164160 00000100:00100000:0.0:1788869724.627788:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869724.627808:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869724.627832:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305164544 00000100:00100000:3.0:1788869724.627836:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305164544 00000100:00100000:3.0:1788869724.627851:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305164672 00000100:00100000:3.0:1788869724.627853:0:18604:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305164672 00000100:00100000:3.0:1788869724.627869:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:3.0:1788869724.627878:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:893992aa-f001-4ff6-aa93-863511511bbf+5:2406:x1875765305164160:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:3.0:1788869724.627909:0:18604:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfeca 00000100:00080000:3.0:1788869724.627924:0:18604:0:(import.c:65:import_set_state_nolock()) ffff8e2704805000 : changing import state from FULL to CLOSED 00000100:00100000:1.0F:1788869724.627972:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305164288 00000100:00100000:1.0:1788869724.627981:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305164288 00000100:00100000:1.0:1788869724.628012:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305164416 00000100:00100000:1.0:1788869724.628015:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305164416 00000100:00100000:1.0:1788869724.628035:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:1.0:1788869724.628042:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284111df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:2409:x1875765305164288:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869724.628106:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:2409:x1875765305164288:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 65us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869724.628113:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:1.0:1788869724.628130:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:1.0:1788869724.628135:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2410:x1875765305164416:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869724.628169:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2410:x1875765305164416:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 34us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869724.628176:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 78 00000001:00000004:3.0:1788869724.628237:0:18604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788869724.628379:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284111ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:893992aa-f001-4ff6-aa93-863511511bbf+2:2406:x1875765305164160:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 501us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869724.628385:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:3.0:1788869724.628398:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:3.0:1788869724.628404:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2406:x1875765305164544:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:3.0:1788869724.628416:0:18604:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cff02 00000100:00080000:3.0:1788869724.628423:0:18604:0:(import.c:65:import_set_state_nolock()) ffff8e2840b8c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788869724.628484:0:18604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1788869724.628571:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+2:2406:x1875765305164544:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 167us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869724.628578:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:3.0:1788869724.628609:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:3.0:1788869724.628615:0:18604:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2406:x1875765305164672:12345-192.168.204.54@tcp:9:kworker.0 00000020:00000080:3.0:1788869724.628627:0:18604:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cff09 00000100:00080000:3.0:1788869724.628639:0:18604:0:(import.c:65:import_set_state_nolock()) ffff8e2840b8c000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788869724.630153:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788869724.630784:0:18604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788869724.630928:0:18604:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+2:2406:x1875765305164672:12345-192.168.204.54@tcp:9:kworker.0 Request processed in 2307us (3113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869724.630939:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00010000:00010000:3.0:1788869724.630974:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788869724.631229:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869724.631235:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869724.631238:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869724.631672:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788869724.632096:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788869724.633363:0:18601:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ddd2cdf9-4380-4081-8309-29d3c6b6c9d2 00000020:00000080:3.0:1788869724.633371:0:18601:0:(genops.c:885:class_export_put()) final put ffff8e2840b8f000/ddd2cdf9-4380-4081-8309-29d3c6b6c9d2 00000001:00080000:3.0:1788869724.633445:0:18601:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:3.0:1788869724.633456:0:18601:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000020:00000080:1.0:1788869724.637691:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840b8f000/ddd2cdf9-4380-4081-8309-29d3c6b6c9d2 for lustre-OST0000 00000020:00000080:3.0:1788869724.640395:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2840b8c800 for lustre-OST0000 00010000:00010000:3.0:1788869724.751995:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788869724.999469:0:17078:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:3.0:1788869724.999508:0:17078:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e282f0ca900 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:3.0:1788869724.999514:0:17078:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e280636a900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e282f0ca300 00000020:00080000:3.0:1788869724.999517:0:17078:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e280636ab00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e2702b36000 00010000:00010000:1.0:1788869724.999577:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d020b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869724.999618:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d020b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869724.999626:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d020b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869724.999633:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869724.999638:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d020b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869724.999659:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d020b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869724.999677:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2701ed4000) 00010000:00010000:1.0:1788869724.999680:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869724.999685:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d020b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869724.999692:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5400/0x4c16c38a9b6d020b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788869724.999804:0:17138:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:0.0:1788869724.999887:0:17138:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1788869725.510827:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325172864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869725.510912:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869725.510999:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325172992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869725.511029:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869725.511063:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325172864 00000100:00100000:3.0:1788869725.511071:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325172864 00000100:00100000:3.0:1788869725.511117:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325172992 00000100:00100000:3.0:1788869725.511128:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325172992 00000100:00100000:3.0:1788869725.511162:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788869725.511171:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325172864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788869725.511202:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788869725.511259:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325172864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869725.511266:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788869725.511281:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788869725.511287:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325172992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869725.511295:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788869725.511321:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325172992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869725.511327:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788869725.511343:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869725.511386:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325172864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869725.511422:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325172992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869725.511809:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325173504:0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.511848:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869725.511870:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325174016:0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.511891:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869725.511917:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788869725.511922:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325173120:0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.511946:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869725.511971:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325173632:0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.511995:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869725.512013:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325174144:0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.512033:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869725.512058:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325173248:0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.512081:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869725.512099:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325173760:0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.512120:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869725.512146:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325174272:0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.512169:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869725.512184:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788869725.512189:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325173376:0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.512221:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869725.512368:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325173504 00000100:00100000:3.0:1788869725.512374:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325173504 00000100:00100000:3.0:1788869725.512400:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325174016 00000100:00100000:3.0:1788869725.512403:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325174016 00000100:00100000:3.0:1788869725.512421:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325174144 00000100:00100000:3.0:1788869725.512423:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325174144 00000100:00100000:3.0:1788869725.512433:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325174272 00000100:00100000:3.0:1788869725.512435:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325174272 00000100:00100000:3.0:1788869725.512451:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788869725.512459:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325173504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869725.512504:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325173504:12345-0@lo:400:kworker.0 Request processed in 46us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869725.512517:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788869725.512530:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788869725.512535:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325174016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869725.512560:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325174016:12345-0@lo:400:kworker.0 Request processed in 25us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869725.512566:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788869725.512575:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788869725.512580:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325174144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869725.512637:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325174144:12345-0@lo:400:kworker.0 Request processed in 57us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869725.512643:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788869725.512654:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788869725.512659:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325174272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869725.512684:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325174272:12345-0@lo:400:kworker.0 Request processed in 26us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869725.512690:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1788869725.512705:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869725.512709:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869725.512835:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325173888:0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.512859:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869725.512876:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27028a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325174400:0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.512896:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869725.512921:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325174272:0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.512950:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325173888 00000100:00100000:0.0:1788869725.512954:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325173888 00000100:00100000:0.0:1788869725.512973:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325174400 00000100:00100000:0.0:1788869725.512975:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325174400 00000100:00100000:0.0:1788869725.512998:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788869725.513003:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325173888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.513036:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325173888:12345-0@lo:400:kworker.0 Request processed in 33us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869725.513042:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788869725.513054:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788869725.513060:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325174400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.513086:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325174400:12345-0@lo:400:kworker.0 Request processed in 26us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869725.513091:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788869725.513109:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325173120 00000100:00100000:0.0:1788869725.513113:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325173120 00000100:00100000:0.0:1788869725.513149:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788869725.513156:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3648:x1875765325173120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.513184:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3648:x1875765325173120:12345-0@lo:400:kworker.0 Request processed in 30us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869725.513198:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788869725.514084:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325173760 00000100:00100000:3.0:1788869725.514092:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325173760 00000100:00100000:3.0:1788869725.514127:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325173376 00000100:00100000:3.0:1788869725.514130:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325173376 00000100:00100000:3.0:1788869725.514177:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788869725.514185:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325173760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869725.514323:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325173760:12345-0@lo:400:kworker.0 Request processed in 139us (2201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869725.514341:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788869725.514354:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788869725.514359:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325173376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869725.514385:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325173376:12345-0@lo:400:kworker.0 Request processed in 27us (2164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869725.514390:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788869725.517694:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325173632 00000100:00100000:0.0:1788869725.517713:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325173632 00000100:00100000:0.0:1788869725.517839:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325173248 00000100:00100000:0.0:1788869725.517843:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325173248 00000100:00100000:0.0:1788869725.517866:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788869725.517877:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325173632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.517972:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325173632:12345-0@lo:400:kworker.0 Request processed in 97us (5975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869725.517980:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788869725.517999:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788869725.518004:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283f47c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325173248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.518034:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283f47c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325173248:12345-0@lo:400:kworker.0 Request processed in 31us (5952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869725.518040:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1788869725.518085:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788869725.518091:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869725.518127:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325173120:0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.518155:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325173632:0@lo:400:kworker.0 00010000:00080000:0.0:1788869725.518171:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282da88380 x1875765325174144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869725.518183:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325174144:0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.518197:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325173504:0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.518209:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325174016:0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.519905:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1788869725.519917:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e270402e300, transno 8589934596 00000004:00080000:0.0:1788869725.519946:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1788869725.519969:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325173376:0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.519986:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325173888:0@lo:400:kworker.0 00010000:00080000:0.0:1788869725.520001:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27028a0700 x1875765325174400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869725.520012:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27028a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325174400:0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.520025:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325173248:0@lo:400:kworker.0 00000100:00100000:0.0:1788869725.520037:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325173760:0@lo:400:kworker.0 00010000:00010000:3.0:1788869725.766721:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869726.021915:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869726.021949:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325174528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869726.022053:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869726.022224:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325174528 00000100:00100000:2.0:1788869726.022233:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325174528 00000100:00100000:2.0:1788869726.022296:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788869726.022307:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325174528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869726.022339:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788869726.022403:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325174528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869726.022410:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788869726.022797:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325174528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869726.027308:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325174656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869726.027388:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869726.027706:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325174656 00000100:00100000:0.0:1788869726.027715:0:18609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325174656 00000100:00100000:0.0:1788869726.027773:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788869726.027784:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325174656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869726.027808:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788869726.029199:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325174656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1412us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869726.029211:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325174656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869726.029211:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788869726.073430:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869726.074014:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305164800 00000100:00100000:0.0:1788869726.074025:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305164800 00000100:00080000:3.0:1788869726.074405:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869726.074603:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:0.0:1788869726.074617:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+12:15585:x1875765305164800:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788869726.074749:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+12:15585:x1875765305164800:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 Request processed in 136us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869726.074770:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:1.0:1788869726.077340:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869726.077403:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305164928 00000100:00100000:1.0:1788869726.077414:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305164928 00000100:00100000:1.0:1788869726.077480:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:1.0:1788869726.077491:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+5:15585:x1875765305164928:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788869726.077608:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:893992aa-f001-4ff6-aa93-863511511bbf+5:15585:x1875765305164928:12345-192.168.204.54@tcp:60:lhsmtool_posix.0 Request processed in 96us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869726.077616:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00080000:1.0:1788869726.077638:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869726.088343:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869726.088509:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305165184 00000100:00100000:1.0:1788869726.088520:0:17101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305165184 00000100:00100000:1.0:1788869726.088648:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:1.0:1788869726.088658:0:17101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840a41450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:893992aa-f001-4ff6-aa93-863511511bbf+12:15585:x1875765305165184:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788869726.089389:0:17101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840a41450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:893992aa-f001-4ff6-aa93-863511511bbf+13:15585:x1875765305165184:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 727us (1052us total) trans 8589934636 rc 0/0 00000100:00100000:1.0:1788869726.089400:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000040:00080000:2.0:1788869726.283024:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788869726.534791:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325174912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869726.534849:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325174784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869726.539865:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869726.539947:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869726.540008:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325174784 00000100:00100000:0.0:1788869726.540022:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325174784 00000100:00100000:0.0:1788869726.540086:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325174912 00000100:00100000:0.0:1788869726.540090:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325174912 00000100:00100000:0.0:1788869726.540109:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788869726.540131:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325174784:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869726.540168:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788869726.540181:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325174912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869726.540181:0:18122:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000004:00000024:2.0:1788869726.540211:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788869726.540264:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325174784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869726.540268:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325174912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869726.540277:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788869726.541673:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325174784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869726.541840:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325174912:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869726.548146:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:3.0:1788869726.794026:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869727.815967:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869728.332567:0:20476:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 08:15:25 (1788869725) 00010000:00010000:3.0:1788869728.837941:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869729.725872:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869729.725916:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869729.725938:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869729.726017:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305165696 00000100:00100000:3.0:1788869729.726028:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305165696 00000100:00100000:3.0:1788869729.726105:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:3.0:1788869729.726115:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:893992aa-f001-4ff6-aa93-863511511bbf+6:2408:x1875765305165696:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869729.726197:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:893992aa-f001-4ff6-aa93-863511511bbf+6:2408:x1875765305165696:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 84us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869729.726205:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:1.0:1788869729.728075:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869729.728121:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869729.728192:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305165312 00000100:00100000:3.0:1788869729.728201:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305165312 00000100:00100000:3.0:1788869729.728246:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 172 00000100:00100000:3.0:1788869729.728255:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+13:2408:x1875765305165312:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869729.728326:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56e01919-a919-418f-8d7b-865b418e1c3f+13:2408:x1875765305165312:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 72us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869729.728334:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 172 00000100:00100000:1.0:1788869729.732043:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869729.732099:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305165440 00000100:00100000:2.0:1788869729.732110:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305165440 00000100:00100000:0.0:1788869729.732267:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305165952 00000100:00100000:0.0:1788869729.732272:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305165952 00000100:00100000:0.0:1788869729.732335:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305165568 00000100:00100000:0.0:1788869729.732339:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305165568 00000100:00100000:0.0:1788869729.732360:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:0.0:1788869729.732370:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e28179e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2408:x1875765305165952:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869729.732445:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e28179e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2408:x1875765305165952:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 77us (6505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869729.732453:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 85 00000100:00100000:0.0:1788869729.732472:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00100000:0.0:1788869729.732479:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+5:2408:x1875765305165568:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869729.732506:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+5:2408:x1875765305165568:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 28us (4385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869729.732512:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 86 00000100:00080000:1.0:1788869729.733347:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869729.733354:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869729.733444:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305165824 00000100:00100000:0.0:1788869729.733450:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305165824 00000100:00100000:0.0:1788869729.733502:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00100000:0.0:1788869729.733510:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:2408:x1875765305165824:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869729.733554:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:2408:x1875765305165824:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 45us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869729.733560:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 87 00000100:00080000:1.0:1788869729.733913:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869729.734481:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00100000:3.0:1788869729.734490:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2840f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+13:2408:x1875765305165440:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869729.734555:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2840f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+13:2408:x1875765305165440:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 65us (8970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869729.734562:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 88 00000100:00080000:1.0:1788869729.736538:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788869729.875424:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788869730.128952:0:19421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ddd2cdf9-4380-4081-8309-29d3c6b6c9d2 00000020:00000080:1.0:1788869730.128965:0:19421:0:(genops.c:885:class_export_put()) final put ffff8e2840b89800/ddd2cdf9-4380-4081-8309-29d3c6b6c9d2 00000001:00100000:1.0:1788869730.128991:0:19421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 893992aa-f001-4ff6-aa93-863511511bbf 00000020:00000080:1.0:1788869730.128994:0:19421:0:(genops.c:885:class_export_put()) final put ffff8e2704804000/893992aa-f001-4ff6-aa93-863511511bbf 00000020:00000080:0.0:1788869730.129783:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840b89800/ddd2cdf9-4380-4081-8309-29d3c6b6c9d2 for lustre-OST0001 00000020:00000080:0.0:1788869730.129846:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2704804000/893992aa-f001-4ff6-aa93-863511511bbf for lustre-OST0001 00000020:00000080:0.0:1788869730.129876:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2840b8c000 for lustre-OST0001 00000020:00000080:0.0:1788869730.129881:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2704805000 for lustre-OST0001 00000100:00100000:3.0:1788869730.631748:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f058000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325175040:0@lo:400:kworker.0 00000100:00100000:3.0:1788869730.631846:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869730.631904:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325175552:0@lo:400:kworker.0 00000100:00100000:3.0:1788869730.631936:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869730.631960:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325176064:0@lo:400:kworker.0 00000100:00100000:3.0:1788869730.631998:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869730.632018:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325176576:0@lo:400:kworker.0 00000100:00100000:3.0:1788869730.632050:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869730.632076:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788869730.632082:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325175168:0@lo:400:kworker.0 00000100:00100000:3.0:1788869730.632107:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869730.632285:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f05a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325175296:0@lo:400:kworker.0 00000100:00100000:3.0:1788869730.632544:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325175680:0@lo:400:kworker.0 00000100:00100000:1.0:1788869730.634219:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325175424:0@lo:400:kworker.0 00000100:00100000:2.0:1788869730.635481:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325175552 00000100:00100000:2.0:1788869730.635496:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325175552 00000100:00100000:2.0:1788869730.635577:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325176064 00000100:00100000:2.0:1788869730.635581:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325176064 00000100:00100000:2.0:1788869730.635811:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325176576 00000100:00100000:2.0:1788869730.635815:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325176576 00000100:00100000:2.0:1788869730.635853:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788869730.635863:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325175552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869730.636020:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788869730.636029:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325176064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869730.636108:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325176064:12345-0@lo:400:kworker.0 Request processed in 80us (4109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869730.636115:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788869730.636145:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788869730.636151:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325176576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869730.636175:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325176576:12345-0@lo:400:kworker.0 Request processed in 25us (4135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869730.636181:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788869730.636201:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325175040 00000100:00100000:0.0:1788869730.636205:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325175040 00000100:00100000:0.0:1788869730.636233:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788869730.636239:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3648:x1875765325175040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869730.636276:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3648:x1875765325175040:12345-0@lo:400:kworker.0 Request processed in 38us (4431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869730.636282:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:0.0:1788869730.636311:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869730.636393:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869730.636435:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325175296 00000100:00100000:0.0:1788869730.636439:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325175296 00000100:00100000:0.0:1788869730.636468:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788869730.636474:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325175296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869730.636502:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325175296:12345-0@lo:400:kworker.0 Request processed in 29us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869730.636507:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788869730.636519:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869730.636555:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f05a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325175296:0@lo:400:kworker.0 00000100:00100000:0.0:1788869730.636566:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325175808:0@lo:400:kworker.0 00000100:00100000:0.0:1788869730.636614:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869730.636641:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325175808 00000100:00100000:0.0:1788869730.636644:0:18606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325175808 00000100:00100000:0.0:1788869730.636667:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788869730.636672:0:18606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27028a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325175808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869730.636696:0:18606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27028a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325175808:12345-0@lo:400:kworker.0 Request processed in 25us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869730.636702:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788869730.636713:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869730.636728:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325175808:0@lo:400:kworker.0 00000100:00100000:0.0:1788869730.636735:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325176320:0@lo:400:kworker.0 00000100:00100000:0.0:1788869730.636766:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869730.636781:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325176320 00000100:00100000:0.0:1788869730.636784:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325176320 00000100:00100000:0.0:1788869730.636803:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788869730.636808:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325176320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869730.636833:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325176320:12345-0@lo:400:kworker.0 Request processed in 25us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869730.636839:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1788869730.636852:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788869730.636868:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27037c5500 x1875765325176320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869730.636880:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325176320:0@lo:400:kworker.0 00000100:00100000:3.0:1788869730.637893:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869730.637937:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325176192:0@lo:400:kworker.0 00000100:00100000:3.0:1788869730.637969:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869730.637998:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f058000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325175040:0@lo:400:kworker.0 00000100:00100000:3.0:1788869730.638015:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325176064:0@lo:400:kworker.0 00010000:00080000:3.0:1788869730.638028:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703913b80 x1875765325176576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869730.638036:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325176576:0@lo:400:kworker.0 00000100:00100000:3.0:1788869730.638089:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325176192 00000100:00100000:3.0:1788869730.638094:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325176192 00000100:00100000:3.0:1788869730.638144:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788869730.638153:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325176192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869730.638203:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325176192:12345-0@lo:400:kworker.0 Request processed in 51us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869730.638210:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788869730.638236:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325175168 00000100:00100000:3.0:1788869730.638240:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325175168 00000100:00100000:3.0:1788869730.638262:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325175680 00000100:00100000:3.0:1788869730.638265:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325175680 00000100:00100000:3.0:1788869730.638279:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788869730.638285:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325175168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869730.638320:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325175168:12345-0@lo:400:kworker.0 Request processed in 35us (6212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869730.638326:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788869730.638353:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788869730.638359:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325175680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869730.638390:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325175680:12345-0@lo:400:kworker.0 Request processed in 32us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869730.638397:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788869730.638700:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325175168:0@lo:400:kworker.0 00000100:00100000:3.0:1788869730.638712:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325175680:0@lo:400:kworker.0 00000100:00100000:3.0:1788869730.638721:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325176192:0@lo:400:kworker.0 00000100:00080000:0.0:1788869730.638821:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869730.638914:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869730.638950:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325175936:0@lo:400:kworker.0 00000100:00100000:1.0:1788869730.638977:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869730.639017:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27037c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765325176448:0@lo:400:kworker.0 00000100:00100000:1.0:1788869730.639054:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869730.639086:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325176448 00000100:00100000:1.0:1788869730.639091:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325176448 00000100:00100000:1.0:1788869730.639141:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788869730.639148:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765325176448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869730.639190:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765325176448:12345-0@lo:400:kworker.0 Request processed in 43us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869730.639196:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788869730.640111:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27037c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765325176448:0@lo:400:kworker.0 00000100:00100000:0.0:1788869730.640231:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325175424 00000100:00100000:0.0:1788869730.640237:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325175424 00000100:00100000:0.0:1788869730.640273:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325175936 00000100:00100000:0.0:1788869730.640276:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325175936 00000100:00100000:0.0:1788869730.640295:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788869730.640304:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325175424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869730.640361:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325175424:12345-0@lo:400:kworker.0 Request processed in 58us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869730.640367:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788869730.640380:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788869730.640385:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325175936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869730.640423:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325175936:12345-0@lo:400:kworker.0 Request processed in 38us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869730.640441:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788869730.640457:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869730.640462:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869730.641085:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325175424:0@lo:400:kworker.0 00000100:00100000:1.0:1788869730.641098:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325175936:0@lo:400:kworker.0 00000100:00100000:2.0:1788869730.642328:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325175552:12345-0@lo:400:kworker.0 Request processed in 6461us (10385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869730.642340:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788869730.642519:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325176704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869730.642558:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869730.642763:0:20240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325176704 00000100:00100000:2.0:1788869730.642770:0:20240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325176704 00000100:00100000:2.0:1788869730.642809:0:20240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788869730.642816:0:20240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325176704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869730.642843:0:20240:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788869730.642949:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282da88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325175552:0@lo:400:kworker.0 00000100:00100000:0.0:1788869730.642972:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325176832:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869730.642999:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869730.643020:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325176832 00000100:00100000:0.0:1788869730.643024:0:18609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325176832 00000100:00100000:0.0:1788869730.643053:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788869730.643061:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325176832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869730.643071:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788869730.643095:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325176832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869730.643100:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788869730.645457:0:20240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325176704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2633us (2890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869730.645471:0:20240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788869730.646147:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325176832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869730.649865:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325176704:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788869730.889167:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869731.142540:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325176960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869731.142673:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869731.142897:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325176960 00000100:00100000:2.0:1788869731.142905:0:18609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325176960 00000100:00100000:2.0:1788869731.142963:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788869731.142974:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325176960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869731.143008:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788869731.143073:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325176960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869731.143082:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788869731.143131:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325176960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869731.143206:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325177088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869731.143239:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869731.143323:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325177088 00000100:00100000:2.0:1788869731.143343:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325177088 00000100:00100000:2.0:1788869731.143373:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788869731.143379:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325177088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788869731.143393:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788869731.143426:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325177088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869731.143433:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788869731.143462:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325177088:0@lo:13:osp-pre-0-1.0 00000001:00080000:3.0:1788869731.146192:0:17078:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:3.0:1788869731.146213:0:17078:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:0.0:1788869731.146339:0:17138:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:0.0:1788869731.146353:0:17138:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000100:00100000:2.0:1788869731.654740:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869731.654764:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325177216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869731.654835:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869731.655009:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325177216 00000100:00100000:3.0:1788869731.655017:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325177216 00000100:00100000:3.0:1788869731.655079:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788869731.655088:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325177216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869731.655120:0:17104:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788869731.655164:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325177216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869731.655170:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788869731.655256:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325177216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869731.655257:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869731.655274:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325177344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869731.655310:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869731.655408:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325177344 00000100:00100000:2.0:1788869731.655413:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325177344 00000100:00100000:2.0:1788869731.655448:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788869731.655455:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325177344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869731.655474:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788869731.655520:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325177344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869731.655528:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788869731.655666:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325177344:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788869731.909975:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788869732.614019:0:17132:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788869732.614031:0:17132:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869732.614055:0:17132:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788869732.614080:0:17132:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788869732.934652:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869733.527192:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869733.527233:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869733.527276:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869733.527372:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305166080 00000100:00100000:1.0:1788869733.527383:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305166080 00000100:00100000:1.0:1788869733.527444:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305166336 00000100:00100000:1.0:1788869733.527448:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305166336 00000100:00100000:1.0:1788869733.527460:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305166208 00000100:00100000:1.0:1788869733.527463:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305166208 00000100:00100000:1.0:1788869733.527490:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:1.0:1788869733.527500:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56e01919-a919-418f-8d7b-865b418e1c3f+15:2409:x1875765305166080:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869733.527517:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869733.527540:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28029d6600/0x4c16c38a9b6cfea0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca162 expref: 15 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869733.527560:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869733.527678:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56e01919-a919-418f-8d7b-865b418e1c3f+14:2409:x1875765305166080:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 178us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869733.527686:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:1.0:1788869733.527706:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1788869733.527713:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56e01919-a919-418f-8d7b-865b418e1c3f+13:2409:x1875765305166336:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869733.527721:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869733.527730:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840ed9a00/0x4c16c38a9b6cff64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca249 expref: 13 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869733.527740:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869733.527758:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56e01919-a919-418f-8d7b-865b418e1c3f+12:2409:x1875765305166336:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 46us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869733.527776:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1788869733.527789:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1788869733.527805:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56e01919-a919-418f-8d7b-865b418e1c3f+11:2409:x1875765305166208:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869733.527813:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869733.527821:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbb5a00/0x4c16c38a9b6cfea7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca193 expref: 11 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869733.527830:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869733.527861:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56e01919-a919-418f-8d7b-865b418e1c3f+10:2409:x1875765305166208:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 55us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869733.527867:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1788869733.528749:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869733.529005:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305166592 00000100:00100000:3.0:1788869733.529013:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305166592 00000100:00100000:3.0:1788869733.529081:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:3.0:1788869733.529092:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:893992aa-f001-4ff6-aa93-863511511bbf+6:2406:x1875765305166592:12345-192.168.204.54@tcp:9:umount.0 00000100:00080000:0.0:1788869733.529203:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1788869733.529268:0:18991:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfec3 00000020:00010000:3.0:1788869733.529290:0:18991:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e2704805800: total 0 00000100:00080000:3.0:1788869733.529296:0:18991:0:(import.c:65:import_set_state_nolock()) ffff8e2704800800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788869733.529372:0:18991:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000020:00010000:2.0:1788869733.529499:0:17087:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e2704805800: total 0 00010000:00010000:2.0:1788869733.529503:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869733.529556:0:17087:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e2704805800, canceled 0 locks, left on hash table 1. 00002000:00010000:2.0:1788869733.529640:0:17087:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788869733.529643:0:17087:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1788869716 -> 1788869718 00002000:00010000:2.0:1788869733.529646:0:17087:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788869716 -> 1788869718 00002000:00010000:2.0:1788869733.529648:0:17087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788869733.529675:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000471d50ac/0x4c16c38a9b6d0235 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca329 expref: 5 pid: 18991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869733.529701:0:17087:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e2704805800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788869733.529714:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869733.529716:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869733.529718:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869733.530301:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:893992aa-f001-4ff6-aa93-863511511bbf+2:2406:x1875765305166592:12345-192.168.204.54@tcp:9:umount.0 Request processed in 1209us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869733.530311:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:1.0:1788869733.541332:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869733.541423:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305167488 00000100:00100000:0.0:1788869733.541433:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305167488 00000100:00100000:0.0:1788869733.541522:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 76 00000100:00100000:0.0:1788869733.541533:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+12:2406:x1875765305167488:12345-192.168.204.54@tcp:39:umount.0 00000020:00000080:0.0:1788869733.541583:0:17098:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfeb5 00000020:00010000:0.0:1788869733.541628:0:17098:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e2703439800: total 0 00000100:00080000:0.0:1788869733.541632:0:17098:0:(import.c:65:import_set_state_nolock()) ffff8e270343b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788869733.541653:0:17098:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:0.0:1788869733.541799:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:893992aa-f001-4ff6-aa93-863511511bbf+11:2406:x1875765305167488:12345-192.168.204.54@tcp:39:umount.0 Request processed in 268us (477us total) trans 8589934637 rc 0/0 00000100:00100000:0.0:1788869733.541806:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 76 00000020:00010000:3.0:1788869733.542320:0:17086:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e2703439800: total 0 00010000:00010000:3.0:1788869733.542382:0:17086:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e2703439800, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1788869733.542421:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e2701ed4000) 00010000:00010000:3.0:1788869733.542426:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788869733.542435:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d01e1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca306 expref: 10 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869733.542463:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e28131c4a00) 00010000:00010000:3.0:1788869733.542477:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869733.542483:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5000/0x4c16c38a9b6cff9c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca257 expref: 9 pid: 19213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869733.542502:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e28131c4b00) 00010000:00010000:3.0:1788869733.542505:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869733.542509:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4a00/0x4c16c38a9b6cffdb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca265 expref: 8 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869733.542523:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:3.0:1788869733.542526:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788869733.542530:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4600/0x4c16c38a9b6d0186 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca2f1 expref: 7 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869733.542542:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e28131c4500) 00010000:00010000:3.0:1788869733.542554:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788869733.542560:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8e00/0x4c16c38a9b6d0243 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca330 expref: 6 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869733.542577:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e28131c4000) 00010000:00010000:3.0:1788869733.542579:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869733.542583:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb5c00/0x4c16c38a9b6cff80 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca250 expref: 5 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869733.542647:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e2701ed4800) 00010000:00010000:3.0:1788869733.542650:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788869733.542654:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed9000/0x4c16c38a9b6d0060 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca28f expref: 4 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869733.542666:0:17086:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e2703439800, canceled 7 locks, left on hash table 0. 00010000:00010000:3.0:1788869733.542681:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869733.542683:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869733.542685:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788869733.543388:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869733.553345:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869733.553477:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305167616 00000100:00100000:1.0:1788869733.553490:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305167616 00000100:00100000:1.0:1788869733.553607:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00100000:1.0:1788869733.553620:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+5:2406:x1875765305167616:12345-192.168.204.54@tcp:39:umount.0 00000020:00000080:1.0:1788869733.553665:0:17099:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfebc 00000100:00080000:1.0:1788869733.553685:0:17099:0:(import.c:65:import_set_state_nolock()) ffff8e270343e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788869733.553723:0:17099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1788869733.553943:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869733.554309:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:893992aa-f001-4ff6-aa93-863511511bbf+3:2406:x1875765305167616:12345-192.168.204.54@tcp:39:umount.0 Request processed in 690us (976us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788869733.554318:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 77 00000100:00080000:2.0:1788869733.555029:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788869733.957940:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869734.841374:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869734.841550:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305167744 00000100:00100000:2.0:1788869734.841561:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305167744 00000100:00100000:2.0:1788869734.841667:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:2.0:1788869734.841679:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+10:2410:x1875765305167744:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869734.841761:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56e01919-a919-418f-8d7b-865b418e1c3f+10:2410:x1875765305167744:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 85us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869734.841768:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 174 00000100:00100000:3.0:1788869734.843079:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869734.846095:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869734.846245:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305167872 00000100:00100000:3.0:1788869734.846256:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305167872 00000100:00100000:3.0:1788869734.846341:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305168000 00000100:00100000:3.0:1788869734.846344:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305168000 00000100:00100000:3.0:1788869734.846368:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 95 00000100:00100000:3.0:1788869734.846378:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:2410:x1875765305167872:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869734.846546:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00100000:0.0:1788869734.846558:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2409:x1875765305168000:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869734.846669:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2409:x1875765305168000:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 114us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869734.846676:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 96 00000100:00080000:2.0:1788869734.847126:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869734.847132:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869734.847312:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:2410:x1875765305167872:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 935us (4239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869734.847320:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 95 00010000:00010000:0.0:1788869734.981789:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869735.750085:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325177472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869735.750174:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869735.750301:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869735.750313:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71f22428-daa5-41c2-b06f-55c4031bf12e:3649:1875765325177600:0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.750442:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325178112:0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.750523:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869735.750542:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325177472 00000100:00100000:3.0:1788869735.750553:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325177472 00000100:00100000:0.0:1788869735.750567:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325178624:0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.750641:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869735.750672:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788869735.750678:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788869735.750684:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325177728:0@lo:400:kworker.0 00000100:00100000:3.0:1788869735.750696:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325177472:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869735.750715:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788869735.750735:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788869735.750758:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325178240:0@lo:400:kworker.0 00000100:00080000:2.0:1788869735.751053:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869735.751080:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325178112 00000100:00100000:2.0:1788869735.751087:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325178112 00000100:00100000:2.0:1788869735.751133:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325177728 00000100:00100000:2.0:1788869735.751138:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325177728 00000100:00100000:2.0:1788869735.751156:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788869735.751186:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325178112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.758064:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869735.758190:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325178752:0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.758260:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869735.758326:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325179136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869735.758362:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869735.758640:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325177856:0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.758672:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869735.758697:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325178368:0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.758719:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869735.758748:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325178880:0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.758771:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869735.758795:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788869735.759071:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325177984:0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.759105:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869735.759128:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325178496:0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.759152:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869735.759166:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325179008:0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.759187:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869735.759237:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788869735.759259:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325177728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.759539:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325177728:12345-0@lo:400:kworker.0 Request processed in 289us (8823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869735.759548:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788869735.759772:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325178624 00000100:00100000:0.0:1788869735.759784:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325178624 00000100:00100000:0.0:1788869735.759874:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325178752 00000100:00100000:0.0:1788869735.759904:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325178752 00000100:00100000:0.0:1788869735.759925:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325178880 00000100:00100000:0.0:1788869735.759928:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325178880 00000100:00100000:0.0:1788869735.759957:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325177984 00000100:00100000:0.0:1788869735.759961:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325177984 00000100:00100000:0.0:1788869735.759977:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325178496 00000100:00100000:0.0:1788869735.759980:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325178496 00000100:00100000:0.0:1788869735.759991:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325179008 00000100:00100000:0.0:1788869735.759994:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325179008 00000100:00100000:0.0:1788869735.760012:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788869735.760019:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325178624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.760063:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325178624:12345-0@lo:400:kworker.0 Request processed in 45us (9422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869735.760069:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788869735.760083:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788869735.760090:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325178752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.760118:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325178752:12345-0@lo:400:kworker.0 Request processed in 29us (1857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869735.760124:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788869735.760135:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788869735.760141:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325178880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.760175:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875765325178880:12345-0@lo:400:kworker.0 Request processed in 34us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869735.760181:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788869735.760194:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788869735.760199:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325177984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.760225:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325177984:12345-0@lo:400:kworker.0 Request processed in 26us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869735.760241:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788869735.760253:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788869735.760259:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325178496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.760290:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325178496:12345-0@lo:400:kworker.0 Request processed in 31us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869735.760296:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788869735.760320:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788869735.760327:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325179008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.760355:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325179008:12345-0@lo:400:kworker.0 Request processed in 29us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869735.760361:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788869735.760384:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325178240 00000100:00100000:0.0:1788869735.760389:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325178240 00000100:00100000:3.0:1788869735.761034:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325177472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10336us (10851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869735.761052:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788869735.761108:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325177856 00000100:00100000:3.0:1788869735.761117:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325177856 00000100:00100000:3.0:1788869735.761157:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325178368 00000100:00100000:3.0:1788869735.761161:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325178368 00000100:00100000:3.0:1788869735.761178:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788869735.761188:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27037c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325178240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.761227:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788869735.761242:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325177856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869735.761272:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27037c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325178240:12345-0@lo:400:kworker.0 Request processed in 84us (3227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869735.761279:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788869735.761298:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788869735.761306:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325178368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869735.761352:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325178368:12345-0@lo:400:kworker.0 Request processed in 47us (2632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869735.761359:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788869735.761393:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325177856:12345-0@lo:400:kworker.0 Request processed in 155us (2718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869735.761402:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788869735.761466:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325179136 00000100:00100000:3.0:1788869735.761471:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325179136 00000100:00100000:3.0:1788869735.761494:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788869735.761500:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282da88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325179136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869735.761532:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788869735.761562:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325177984:0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.761608:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325178496:0@lo:400:kworker.0 00010000:00080000:0.0:1788869735.761638:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f046a00 x1875765325179008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869735.761650:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325179008:0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.761663:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325177856:0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.761687:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325178368:0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.761699:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875765325178880:0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.761765:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325179136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869735.761778:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325177728:0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.761789:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325178240:0@lo:400:kworker.0 00000100:00100000:3.0:1788869735.761859:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282da88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325179136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (3263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869735.761870:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1788869735.761928:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788869735.761933:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869735.761935:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869735.761948:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869735.762011:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325177472:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788869735.762071:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f045180 x1875765325178752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869735.762088:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325178752:0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.762110:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325178624:0@lo:400:kworker.0 00000100:00100000:1.0:1788869735.762273:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869735.764974:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325177600 00000100:00100000:0.0:1788869735.765000:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325177600 00000100:00100000:0.0:1788869735.765173:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788869735.765186:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3649:x1875765325177600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.765769:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3649:x1875765325177600:12345-0@lo:400:kworker.0 Request processed in 582us (3494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869735.765780:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788869735.765924:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325178112:12345-0@lo:400:kworker.0 Request processed in 14737us (15399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869735.765935:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788869735.766065:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325178112:0@lo:400:kworker.0 00000100:00100000:1.0:1788869735.766220:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71f22428-daa5-41c2-b06f-55c4031bf12e:3649:1875765325177600:0@lo:400:kworker.0 00000100:00100000:0.0:1788869735.951500:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869735.951550:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869735.951637:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869735.951778:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305168128 00000100:00100000:2.0:1788869735.951793:0:17085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305168128 00000100:00100000:2.0:1788869735.951862:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305168384 00000100:00100000:2.0:1788869735.951865:0:17085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305168384 00000100:00100000:2.0:1788869735.951879:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305168256 00000100:00100000:2.0:1788869735.951882:0:17085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305168256 00000100:00100000:2.0:1788869735.951901:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1788869735.951913:0:17085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56e01919-a919-418f-8d7b-865b418e1c3f+12:2407:x1875765305168128:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869735.951951:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869735.951979:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28029d7000/0x4c16c38a9b6cfedf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca1d2 expref: 12 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869735.952003:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869735.952233:0:17085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56e01919-a919-418f-8d7b-865b418e1c3f+11:2407:x1875765305168128:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 321us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869735.952243:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1788869735.952266:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:2.0:1788869735.952273:0:17085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56e01919-a919-418f-8d7b-865b418e1c3f+10:2407:x1875765305168384:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869735.952282:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869735.952292:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7ec00/0x4c16c38a9b6cff5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca242 expref: 10 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869735.952304:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869735.952345:0:17085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56e01919-a919-418f-8d7b-865b418e1c3f+9:2407:x1875765305168384:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 72us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869735.952351:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:2.0:1788869735.952364:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:2.0:1788869735.952371:0:17085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56e01919-a919-418f-8d7b-865b418e1c3f+8:2407:x1875765305168256:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869735.952379:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869735.952387:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28029d7e00/0x4c16c38a9b6cfee6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca203 expref: 8 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869735.952397:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869735.952413:0:17085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56e01919-a919-418f-8d7b-865b418e1c3f+7:2407:x1875765305168256:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 43us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869735.952420:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:0.0:1788869735.965689:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869735.965801:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305168640 00000100:00100000:2.0:1788869735.965815:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305168640 00000100:00100000:2.0:1788869735.965897:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 78 00000100:00100000:2.0:1788869735.965910:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+6:2406:x1875765305168640:12345-192.168.204.54@tcp:39:umount.0 00000020:00000080:2.0:1788869735.965987:0:19213:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfef4 00000020:00010000:2.0:1788869735.965999:0:19213:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e2703553000: total 0 00000100:00080000:2.0:1788869735.966005:0:19213:0:(import.c:65:import_set_state_nolock()) ffff8e2704801000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788869735.966053:0:19213:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00100000:2.0:1788869735.966255:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2406:x1875765305168640:12345-192.168.204.54@tcp:39:umount.0 Request processed in 347us (583us total) trans 8589934638 rc 0/0 00000100:00100000:2.0:1788869735.966264:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 78 00000020:00010000:0.0:1788869735.966792:0:17086:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e2703553000: total 0 00010000:00010000:0.0:1788869735.966816:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869735.966892:0:17086:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e2703553000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788869735.966961:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e28131c4b00) 00010000:00010000:0.0:1788869735.966966:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869735.966980:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6cffe9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca26c expref: 4 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869735.967010:0:17086:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e2703553000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788869735.967022:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869735.967024:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869735.967026:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869735.976304:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869735.976435:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305168768 00000100:00100000:1.0:1788869735.976450:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305168768 00000100:00100000:1.0:1788869735.976535:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 79 00000100:00100000:1.0:1788869735.976549:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+5:2406:x1875765305168768:12345-192.168.204.54@tcp:39:umount.0 00000020:00000080:1.0:1788869735.976655:0:17098:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfefb 00000100:00080000:1.0:1788869735.976673:0:17098:0:(import.c:65:import_set_state_nolock()) ffff8e2704803800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788869735.976714:0:17098:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:2.0:1788869735.977271:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869735.977393:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddd2cdf9-4380-4081-8309-29d3c6b6c9d2+3:2406:x1875765305168768:12345-192.168.204.54@tcp:39:umount.0 Request processed in 843us (1102us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788869735.977405:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 79 00010000:00010000:0.0:1788869736.005827:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869736.025377:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869736.025489:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305169024 00000100:00100000:0.0:1788869736.025502:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305169024 00000100:00100000:0.0:1788869736.025579:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 176 00000100:00100000:0.0:1788869736.025626:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+7:2406:x1875765305169024:12345-192.168.204.54@tcp:251:umount.0 00000020:00000080:0.0:1788869736.025689:0:17092:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfe92 00000020:00010000:0.0:1788869736.025700:0:17092:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e2704800000: total 0 00000100:00080000:0.0:1788869736.025707:0:17092:0:(import.c:65:import_set_state_nolock()) ffff8e2703556000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788869736.025810:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56e01919-a919-418f-8d7b-865b418e1c3f+3:2406:x1875765305169024:12345-192.168.204.54@tcp:251:umount.0 Request processed in 221us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869736.025819:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 176 00000020:00010000:2.0:1788869736.027425:0:17087:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e2704800000: total 0 00010000:00010000:2.0:1788869736.027524:0:17087:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e2704800000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788869736.027640:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7f600/0x4c16c38a9b6cfe99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca15b expref: 2 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869736.027663:0:17087:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e2704800000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788869736.027677:0:17087:0:(genops.c:885:class_export_put()) final put ffff8e2704800000/56e01919-a919-418f-8d7b-865b418e1c3f 00010000:00010000:2.0:1788869736.027695:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869736.027698:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869736.027699:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788869736.027785:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2704800000/56e01919-a919-418f-8d7b-865b418e1c3f for MGS 00000020:00000080:0.0:1788869736.027837:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2703556000 for MGS 00000100:00100000:1.0:1788869736.262905:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869736.262952:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325179264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869736.263056:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869736.263116:0:20240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325179264 00000100:00100000:1.0:1788869736.263126:0:20240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325179264 00000100:00100000:1.0:1788869736.263184:0:20240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788869736.263195:0:20240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325179264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869736.263236:0:20240:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788869736.263289:0:20240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325179264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869736.263297:0:20240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788869736.263353:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325179264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869736.264188:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325179392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869736.264251:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869736.264646:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325179392 00000100:00100000:3.0:1788869736.264657:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325179392 00000100:00100000:3.0:1788869736.264857:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788869736.264869:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325179392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869736.264896:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788869736.265456:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325179392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 586us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869736.265465:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788869736.265896:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325179392:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1788869736.521735:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788869736.773953:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869736.773985:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325179520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869736.774289:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869736.774502:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325179520 00000100:00100000:1.0:1788869736.774512:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325179520 00000100:00100000:1.0:1788869736.774579:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788869736.774616:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325179520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869736.774678:0:18122:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788869736.774748:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325179520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 158us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869736.774756:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788869736.774966:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325179520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869736.775706:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869736.775727:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325179648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869736.775799:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869736.776415:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325179648 00000100:00100000:0.0:1788869736.776427:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325179648 00000100:00100000:0.0:1788869736.776483:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788869736.776507:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325179648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869736.776552:0:17104:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788869736.776939:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325179648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 444us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869736.776948:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788869736.777039:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325179648:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788869737.040064:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869738.060317:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788869738.832662:0:17831:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ddd2cdf9-4380-4081-8309-29d3c6b6c9d2 00000001:00080000:1.0:1788869738.832677:0:17831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1788869738.832682:0:17831:0:(genops.c:885:class_export_put()) final put ffff8e2704806800/ddd2cdf9-4380-4081-8309-29d3c6b6c9d2 00000001:00100000:1.0:1788869738.832698:0:17831:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 893992aa-f001-4ff6-aa93-863511511bbf 00000001:00080000:1.0:1788869738.832779:0:17831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1788869738.832782:0:17831:0:(genops.c:885:class_export_put()) final put ffff8e270343c800/893992aa-f001-4ff6-aa93-863511511bbf 00000020:00000080:1.0:1788869738.832796:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2704806800/ddd2cdf9-4380-4081-8309-29d3c6b6c9d2 for lustre-MDT0001 00000020:00000080:1.0:1788869738.832942:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e270343c800/893992aa-f001-4ff6-aa93-863511511bbf for lustre-MDT0001 00000020:00000080:1.0:1788869738.832989:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2704803800 for lustre-MDT0001 00000020:00000080:1.0:1788869738.832996:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e270343e800 for lustre-MDT0001 00000001:00100000:0.0:1788869738.837119:0:18601:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 893992aa-f001-4ff6-aa93-863511511bbf 00000020:00000080:0.0:1788869738.837130:0:18601:0:(genops.c:885:class_export_put()) final put ffff8e2704805800/893992aa-f001-4ff6-aa93-863511511bbf 00000020:00000080:1.0:1788869738.837661:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2704805800/893992aa-f001-4ff6-aa93-863511511bbf for lustre-OST0000 00000020:00000080:1.0:1788869738.837724:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2704800800 for lustre-OST0000 00000001:00100000:0.0:1788869738.837756:0:17078:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ddd2cdf9-4380-4081-8309-29d3c6b6c9d2 00000001:00080000:0.0:1788869738.837777:0:17078:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:0.0:1788869738.837780:0:17078:0:(genops.c:885:class_export_put()) final put ffff8e2703553000/ddd2cdf9-4380-4081-8309-29d3c6b6c9d2 00000001:00100000:0.0:1788869738.837796:0:17078:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 893992aa-f001-4ff6-aa93-863511511bbf 00000001:00080000:0.0:1788869738.837801:0:17078:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:0.0:1788869738.837803:0:17078:0:(genops.c:885:class_export_put()) final put ffff8e2703439800/893992aa-f001-4ff6-aa93-863511511bbf 00000020:00000080:2.0:1788869738.837919:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2703553000/ddd2cdf9-4380-4081-8309-29d3c6b6c9d2 for lustre-MDT0000 00000020:00000080:2.0:1788869738.837963:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2703439800/893992aa-f001-4ff6-aa93-863511511bbf for lustre-MDT0000 00000020:00000080:2.0:1788869738.837992:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2704801000 for lustre-MDT0000 00000020:00000080:2.0:1788869738.837998:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e270343b000 for lustre-MDT0000 00000020:01000004:0.0:1788869738.904397:0:20673:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788869738.928833:0:20673:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788869738.928912:0:20673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6cfa55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfa5c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869738.928931:0:20673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6cfa55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfa5c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869738.928940:0:20673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6cfa55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cfa5c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869738.928948:0:20673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6cfa55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cfa5c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869738.928992:0:20673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788869738.928999:0:20673:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788869738.929026:0:20673:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788869738.929032:0:20673:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788869738.929039:0:20673:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788869738.929069:0:20673:0:(import.c:65:import_set_state_nolock()) ffff8e280a6c0000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788869738.929686:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869738.929694:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6cfa55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cfa5c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.929702:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8200 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869738.929706:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6cfa55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cfa5c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.929728:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6cfa55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6cfa5c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869738.929734:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6cfa55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6cfa5c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869738.929740:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788869738.929743:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788869738.929746:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788869738.929777:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6cfa55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cfa5c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.929784:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869738.929814:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6cfa55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cfa5c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.929821:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28014a8200/0x4c16c38a9b6cfa55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cfa5c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.929836:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869738.929838:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869738.929840:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869738.929910:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869738.929935:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325179904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869738.930036:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869738.930146:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325179904 00000100:00100000:1.0:1788869738.930156:0:17085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325179904 00000100:00100000:1.0:1788869738.930225:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869738.930236:0:17085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27025f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3648:x1875765325179904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869738.930253:0:17085:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869738.930271:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840eda800/0x4c16c38a9b6cfa5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6cfa55 expref: 24 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.930296:0:17085:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869738.930334:0:17085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27025f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:71f22428-daa5-41c2-b06f-55c4031bf12e+23:3648:x1875765325179904:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869738.930341:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788869738.930346:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765325179776:0@lo:39:umount.0 00000100:00100000:2.0:1788869738.930377:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869738.930402:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325179776 00000100:00100000:1.0:1788869738.930406:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325179776 00000100:00100000:1.0:1788869738.930431:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788869738.930436:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765325179776:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788869738.930461:0:19213:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfa86 00000100:00080000:1.0:1788869738.930469:0:19213:0:(import.c:65:import_set_state_nolock()) ffff8e282db3b000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788869738.930529:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1875765325179776:12345-0@lo:39:umount.0 Request processed in 92us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869738.930536:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:1.0:1788869738.930542:0:19213:0:(genops.c:885:class_export_put()) final put ffff8e2703aeb000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788869738.930561:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788869738.930616:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e280a6c0000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788869738.930628:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765325179776:0@lo:39:umount.0 00000020:00000080:3.0:1788869738.930699:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2703aeb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788869738.930751:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e282db3b000 for lustre-MDT0000 00000100:00100000:3.0:1788869738.930773:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325179904:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788869738.930932:0:20673:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788869738.930935:0:20673:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788869738.930939:0:20673:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788869738.933849:0:20673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a9c00/0x4c16c38a9b6cf9a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cf9ad expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869738.933871:0:20673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a9c00/0x4c16c38a9b6cf9a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cf9ad expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869738.933890:0:20673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a9c00/0x4c16c38a9b6cf9a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cf9ad expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869738.933897:0:20673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e28014a9c00/0x4c16c38a9b6cf9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cf9ad expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869738.933922:0:20673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869738.933929:0:20673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6cfdb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfdb9 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869738.933935:0:20673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6cfdb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfdb9 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869738.933961:0:20673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6cfdb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cfdb9 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869738.933967:0:20673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6cfdb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cfdb9 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869738.933980:0:20673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788869738.933986:0:20673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cff4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cff56 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869738.933993:0:20673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cff4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cff56 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869738.933999:0:20673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cff4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cff56 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869738.934005:0:20673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cff4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cff56 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.934012:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869738.934014:0:20673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788869738.934018:0:20673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a9800/0x4c16c38a9b6cf998 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cf99f expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.934020:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28014a9c00/0x4c16c38a9b6cf9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cf9ad expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869738.934025:0:20673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a9800/0x4c16c38a9b6cf998 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cf99f expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.934027:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a9c00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869738.934031:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a9c00/0x4c16c38a9b6cf9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cf9ad expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869738.934032:0:20673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a9800/0x4c16c38a9b6cf998 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cf99f expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.934041:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28014a9c00/0x4c16c38a9b6cf9a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6cf9ad expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869738.934049:0:20673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e28014a9800/0x4c16c38a9b6cf998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cf99f expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869738.934058:0:20673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:00010000:1.0:1788869738.934059:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a9c00/0x4c16c38a9b6cf9a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6cf9ad expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869738.934061:0:20673:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:01000000:1.0:1788869738.934064:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788869738.934066:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1788869738.934069:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:01000004:0.0:1788869738.934089:0:20673:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788869738.934094:0:20673:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788869738.934098:0:20673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1788869738.934103:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e28014a9c00/0x4c16c38a9b6cf9a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cf9ad expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788869738.934105:0:20673:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00010000:00010000:1.0:1788869738.934108:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1788869738.934111:0:20673:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8e270343e000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788869738.934117:0:20673:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8e2840eb7800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788869738.934121:0:20673:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8e2701f1c800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788869738.934125:0:20673:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8e2807dd7000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788869738.934130:0:20673:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8e2840a3cd40) has exports, disconnecting them 00000020:00080000:0.0:1788869738.934133:0:20673:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e270343e000), last request at 1788869735 00000020:00000080:0.0:1788869738.934141:0:20673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfd8f 00010000:00010000:1.0:1788869738.934142:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28014a9c00/0x4c16c38a9b6cf9a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cf9ad expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.934149:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28014a9c00/0x4c16c38a9b6cf9a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cf9ad expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788869738.934157:0:20673:0:(import.c:65:import_set_state_nolock()) ffff8e270343c000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788869738.934163:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788869738.934166:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6cfdb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cfdb9 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.934171:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6400 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869738.934174:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6cfdb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cfdb9 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.934180:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6cfdb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6cfdb9 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869738.934186:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6cfdb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6cfdb9 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788869738.934198:0:20673:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e270343e000): rc 0 00000020:00000080:0.0:1788869738.934200:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e270343e000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788869738.934210:0:20673:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e2840eb7800), last request at 1788869735 10000000:01000000:1.0:1788869738.934211:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788869738.934213:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000020:00000080:0.0:1788869738.934213:0:20673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfc23 10000000:01000000:1.0:1788869738.934215:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00080000:0.0:1788869738.934217:0:20673:0:(import.c:65:import_set_state_nolock()) ffff8e2840eb0000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788869738.934223:0:20673:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2840eb7800): rc 0 00000020:00000080:0.0:1788869738.934225:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e2840eb7800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:1.0:1788869738.934229:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6cfdb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cfdb9 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788869738.934229:0:20673:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e2701f1c800), last request at 1788869654 00000020:00000080:0.0:1788869738.934232:0:20673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfb74 00010000:00010000:1.0:1788869738.934235:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1788869738.934240:0:20673:0:(import.c:65:import_set_state_nolock()) ffff8e2701f1a800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788869738.934241:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6cfdb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cfdb9 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788869738.934246:0:20673:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2701f1c800): rc 0 00010000:00010000:1.0:1788869738.934247:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28029d6400/0x4c16c38a9b6cfdb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cfdb9 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788869738.934248:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e2701f1c800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788869738.934252:0:20673:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e2807dd7000), last request at 1788869654 00000020:00000080:0.0:1788869738.934255:0:20673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfb19 00010000:00010000:1.0:1788869738.934257:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00080000:0.0:1788869738.934258:0:20673:0:(import.c:65:import_set_state_nolock()) ffff8e282d8ca000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788869738.934259:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cff4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cff56 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1788869738.934263:0:20673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00010000:00010000:1.0:1788869738.934265:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e000 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869738.934267:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cff4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cff56 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.934272:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cff4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6cff56 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869738.934278:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cff4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6cff56 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869738.934282:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788869738.934284:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788869738.934289:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788869738.934301:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cff4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cff56 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.934306:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869738.934320:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cff4f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cff56 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.934327:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e000/0x4c16c38a9b6cff4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cff56 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.934337:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:0.0:1788869738.934338:0:20673:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2807dd7000): rc 0 00010000:00010000:1.0:1788869738.934340:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28014a9800/0x4c16c38a9b6cf998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cf99f expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:0.0:1788869738.934343:0:20673:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb9f681dbbae0 00010000:00010000:1.0:1788869738.934345:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a9800 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869738.934347:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a9800/0x4c16c38a9b6cf998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cf99f expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.934352:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28014a9800/0x4c16c38a9b6cf998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6cf99f expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869738.934357:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a9800/0x4c16c38a9b6cf998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6cf99f expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788869738.934359:0:20673:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 10000000:01000000:1.0:1788869738.934362:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000100:00100000:0.0:1788869738.934362:0:20673:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 10000000:01000000:1.0:1788869738.934364:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788869738.934366:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788869738.934375:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e28014a9800/0x4c16c38a9b6cf998 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cf99f expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.934380:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869738.934396:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28014a9800/0x4c16c38a9b6cf998 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cf99f expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.934403:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28014a9800/0x4c16c38a9b6cf998 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cf99f expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.934411:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869738.934413:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869738.934415:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869738.934429:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71f22428-daa5-41c2-b06f-55c4031bf12e:3651:1875765325180160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869738.934491:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869738.934535:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869738.934540:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71f22428-daa5-41c2-b06f-55c4031bf12e:3651:1875765325180032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869738.934558:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869738.934579:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71f22428-daa5-41c2-b06f-55c4031bf12e:3649:1875765325180416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869738.934628:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869738.934645:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869738.934650:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71f22428-daa5-41c2-b06f-55c4031bf12e:3649:1875765325180288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869738.934666:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869738.934685:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325180160 00000100:00100000:1.0:1788869738.934690:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325180160 00000100:00100000:1.0:1788869738.934721:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325180032 00000100:00100000:1.0:1788869738.934723:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325180032 00000100:00100000:1.0:1788869738.934732:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325180416 00000100:00100000:1.0:1788869738.934734:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325180416 00000100:00100000:1.0:1788869738.934743:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325180288 00000100:00100000:1.0:1788869738.934745:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325180288 00000100:00100000:1.0:1788869738.934758:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788869738.934765:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+26:3651:x1875765325180160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869738.934794:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869738.934807:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28029d7200/0x4c16c38a9b6cfdb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6cfdb2 expref: 26 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.934819:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869738.934848:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+25:3651:x1875765325180160:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869738.934855:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788869738.934870:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869738.934889:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+24:3651:x1875765325180032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869738.934895:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869738.934903:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7f200/0x4c16c38a9b6cf9ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6cf9a6 expref: 24 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.934911:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869738.934928:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+23:3651:x1875765325180032:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869738.934934:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869738.934944:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788869738.934949:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+22:3649:x1875765325180416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869738.934955:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869738.934962:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edb000/0x4c16c38a9b6cf99f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6cf998 expref: 22 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.934970:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869738.934990:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+21:3649:x1875765325180416:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869738.935004:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788869738.935015:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788869738.935021:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+20:3649:x1875765325180288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869738.935028:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869738.935035:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7e400/0x4c16c38a9b6cff56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6cff4f expref: 20 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869738.935044:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869738.935063:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:71f22428-daa5-41c2-b06f-55c4031bf12e+19:3649:x1875765325180288:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869738.935068:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:00000080:1.0:1788869738.935083:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e270343e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788869738.935121:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840eb7800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788869738.935140:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2701f1c800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788869738.935160:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e270343c000 for lustre-MDT0000 00000020:00000080:1.0:1788869738.935164:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2840eb0000 for lustre-MDT0000 00000020:00000080:1.0:1788869738.935169:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2701f1a800 for lustre-MDT0000 00000100:00100000:1.0:1788869738.935194:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71f22428-daa5-41c2-b06f-55c4031bf12e:3649:1875765325180288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869738.935202:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:71f22428-daa5-41c2-b06f-55c4031bf12e:3649:1875765325180416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869738.935224:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71f22428-daa5-41c2-b06f-55c4031bf12e:3651:1875765325180032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869738.935230:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71f22428-daa5-41c2-b06f-55c4031bf12e:3651:1875765325180160:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869738.935897:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788869738.940892:0:20673:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788869738.940937:0:20673:0:(import.c:65:import_set_state_nolock()) ffff8e2704140800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788869738.941771:0:20673:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788869738.941777:0:20673:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1788869738.941792:0:20673:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788869738.941858:0:20673:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788869738.941887:0:20673:0:(import.c:65:import_set_state_nolock()) ffff8e282a39b800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788869738.941896:0:20673:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788869738.941898:0:20673:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1788869738.941918:0:20673:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788869738.941984:0:20673:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788869738.941992:0:20673:0:(import.c:65:import_set_state_nolock()) ffff8e282db3e000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788869738.942041:0:20673:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8e2840a3cd40) has no exports 00000100:00100000:1.0:1788869738.944806:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325180544:0@lo:39:umount.0 00000100:00100000:1.0:1788869738.944896:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869738.944951:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325180672:0@lo:9:umount.0 00000100:00100000:2.0:1788869738.944954:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325180544 00000100:00100000:2.0:1788869738.944962:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325180544 00000100:00100000:1.0:1788869738.944977:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869738.945008:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325180800:0@lo:9:umount.0 00000100:00100000:2.0:1788869738.945013:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788869738.945022:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765325180544:12345-0@lo:39:umount.0 00000100:00100000:1.0:1788869738.945026:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788869738.945053:0:17103:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfb9e 00000100:00100000:1.0:1788869738.945062:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325180672 00000100:00080000:2.0:1788869738.945063:0:17103:0:(import.c:65:import_set_state_nolock()) ffff8e280a6c2000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788869738.945065:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325180672 00000001:00000004:2.0:1788869738.945086:0:17103:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788869738.945097:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325180800 00000100:00100000:1.0:1788869738.945100:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325180800 00000100:00100000:1.0:1788869738.945116:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788869738.945122:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765325180672:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788869738.945136:0:18605:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfc69 00000100:00080000:1.0:1788869738.945142:0:18605:0:(import.c:65:import_set_state_nolock()) ffff8e2827a96800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788869738.945176:0:18605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1788869738.945241:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3647:x1875765325180544:12345-0@lo:39:umount.0 Request processed in 219us (344us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788869738.945248:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788869738.945278:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3647:x1875765325180672:12345-0@lo:9:umount.0 Request processed in 155us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869738.945284:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788869738.945296:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788869738.945302:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875765325180800:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788869738.945312:0:18605:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfdc0 00000100:00080000:1.0:1788869738.945318:0:18605:0:(import.c:65:import_set_state_nolock()) ffff8e282daf2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788869738.945334:0:18605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788869738.945421:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3647:x1875765325180800:12345-0@lo:9:umount.0 Request processed in 119us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869738.945427:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1788869738.945447:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788869738.945475:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2704140800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788869738.945482:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325180544:0@lo:39:umount.0 00000100:00080000:1.0:1788869738.945504:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282a39b800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788869738.945521:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788869738.945523:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788869738.945526:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325180672:0@lo:9:umount.0 00000100:00080000:1.0:1788869738.945536:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282db3e000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788869738.945542:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788869738.945544:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788869738.945546:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325180800:0@lo:9:umount.0 00010000:00010000:1.0:1788869738.945566:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788869738.946937:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869738.946946:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1788869738.965020:0:20673:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8e2840a3cd40) has no exports 00000020:00000080:1.0:1788869738.997615:0:20673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cf9f3 00000020:00000080:1.0:1788869738.997632:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e282dac5800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788869738.997648:0:20673:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788869738.997739:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282dac5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788869738.998179:0:20673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869738.998192:0:20673:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788869738.998196:0:20673:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8e2840a399c0) has no exports 00000020:00000080:2.0:1788869738.998537:0:20673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cf9ec 00000020:00000080:2.0:1788869738.998546:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e2811218800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788869738.998767:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2811218800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788869738.998928:0:20673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869738.998937:0:20673:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788869738.998941:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e2840c48000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788869738.998944:0:20673:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840c48000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788869738.998954:0:20673:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1788869739.077884:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869740.108344:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869740.870166:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869740.870197:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325180928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869740.870295:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869740.870575:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325180928 00000100:00100000:2.0:1788869740.870606:0:18609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325180928 00000100:00100000:2.0:1788869740.870684:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788869740.870696:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325180928:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869740.870721:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325181184:0@lo:400:kworker.0 00002000:00000024:2.0:1788869740.870731:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788869740.870772:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869740.870797:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325181696:0@lo:400:kworker.0 00000100:00100000:2.0:1788869740.870804:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325180928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869740.870815:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788869740.870830:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788869740.870851:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869740.870863:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788869740.870870:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325181312:0@lo:400:kworker.0 00000100:00100000:3.0:1788869740.870896:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869740.870924:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325181824:0@lo:400:kworker.0 00000100:00100000:3.0:1788869740.870945:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869740.870967:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325181312 00000100:00100000:2.0:1788869740.870973:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325181312 00000100:00100000:2.0:1788869740.871021:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788869740.871028:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325181312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869740.871069:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325181312:12345-0@lo:400:kworker.0 Request processed in 41us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869740.871082:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788869740.871122:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325181312:0@lo:400:kworker.0 00000100:00100000:2.0:1788869740.871421:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325181696 00000100:00100000:2.0:1788869740.871426:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325181696 00000100:00100000:2.0:1788869740.871458:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325181824 00000100:00100000:2.0:1788869740.871460:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325181824 00000100:00100000:2.0:1788869740.871474:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788869740.871482:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325181696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869740.871526:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325181696:12345-0@lo:400:kworker.0 Request processed in 45us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869740.871532:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788869740.871545:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788869740.871549:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875765325181824:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788869740.871556:0:17099:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788869740.871583:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875765325181824:12345-0@lo:400:kworker.0 Request processed in 33us (637us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788869740.871631:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788869740.871652:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325181184 00000100:00100000:2.0:1788869740.871656:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325181184 00000100:00100000:2.0:1788869740.871679:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788869740.871684:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875765325181184:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788869740.871689:0:17104:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788869740.871713:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875765325181184:12345-0@lo:400:kworker.0 Request processed in 28us (941us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788869740.871718:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788869740.871741:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71f22428-daa5-41c2-b06f-55c4031bf12e:3651:1875765325181056:0@lo:400:kworker.0 00000100:00100000:2.0:1788869740.871873:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788869740.872000:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788869740.872005:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788869740.872152:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788869740.872158:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8e2704807800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788869740.872161:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788869740.873256:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325181440:0@lo:400:kworker.0 00000100:00100000:0.0:1788869740.873317:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869740.873354:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325181952:0@lo:400:kworker.0 00000100:00100000:0.0:1788869740.873377:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869740.873431:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325181440 00000100:00100000:0.0:1788869740.873437:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325181440 00000100:00100000:0.0:1788869740.873467:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325181952 00000100:00100000:0.0:1788869740.873470:0:17098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325181952 00000100:00100000:0.0:1788869740.873506:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788869740.873514:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325181952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869740.873558:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325181952:12345-0@lo:400:kworker.0 Request processed in 45us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869740.873565:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788869740.873580:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788869740.873601:0:17098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1875765325181440:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788869740.873606:0:17098:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788869740.873630:0:17098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1875765325181440:12345-0@lo:400:kworker.0 Request processed in 44us (313us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788869740.873636:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1788869740.873685:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788869740.873689:0:3650:0:(import.c:65:import_set_state_nolock()) ffff8e2701f18000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788869740.873693:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788869740.873697:0:3650:0:(import.c:65:import_set_state_nolock()) ffff8e2701f18000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869740.873702:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 588 00000100:00080000:0.0:1788869740.873711:0:3650:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e2701f18000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869740.873737:0:3650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282f047100 x1875765325182080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788869740.873760:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325181440:0@lo:400:kworker.0 00010000:00080000:0.0:1788869740.873773:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e280138fb80 x1875765325181952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869740.873794:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325181952:0@lo:400:kworker.0 00000100:00100000:0.0:1788869740.873819:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765325182080:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788869740.873854:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869740.873881:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325182080 00000100:00100000:0.0:1788869740.873885:0:17099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325182080 00000100:00100000:0.0:1788869740.873902:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788869740.873907:0:17099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875765325182080:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1788869740.873921:0:17099:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788869740.880994:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325181568:0@lo:400:kworker.0 00000100:00100000:2.0:1788869740.881070:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869740.881498:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325180928:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788869740.881566:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869740.881620:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325181568 00000100:00100000:2.0:1788869740.881627:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325181568 00000100:00100000:2.0:1788869740.881662:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788869740.881669:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1875765325181568:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788869740.881677:0:19213:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788869740.881720:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1875765325181568:12345-0@lo:400:kworker.0 Request processed in 51us (650us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788869740.881727:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788869740.883705:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325181056 00000100:00100000:1.0:1788869740.883719:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325181056 00000100:00080000:2.0:1788869740.883896:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788869740.883902:0:3651:0:(import.c:65:import_set_state_nolock()) ffff8e282db38800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788869740.883907:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788869740.883913:0:3651:0:(import.c:65:import_set_state_nolock()) ffff8e282db38800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869740.883917:0:3651:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 605 00000100:00080000:2.0:1788869740.883930:0:3651:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e282db38800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869740.883963:0:3651:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e270402d180 x1875765325182208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869740.883994:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325181568:0@lo:400:kworker.0 00000100:00100000:2.0:1788869740.884050:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765325182208:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788869740.884110:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869740.884921:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788869740.884937:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e284133cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+19:3651:x1875765325181056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869740.885010:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e284133cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71f22428-daa5-41c2-b06f-55c4031bf12e+19:3651:x1875765325181056:12345-0@lo:400:kworker.0 Request processed in 79us (13135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869740.885018:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788869740.885072:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:71f22428-daa5-41c2-b06f-55c4031bf12e:3651:1875765325181056:0@lo:400:kworker.0 00000100:00100000:1.0:1788869740.886338:0:19213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325182208 00000100:00100000:1.0:1788869740.886364:0:19213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325182208 00000100:00100000:1.0:1788869740.886405:0:19213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788869740.886412:0:19213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875765325182208:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1788869740.886695:0:19213:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788869740.886973:0:19213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875765325182208:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 560us (2862us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788869740.886980:0:19213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788869740.887910:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282db38800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869740.887921:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788869740.887925:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765325182208:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1788869740.923900:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8e2704807800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869740.923915:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 623 00000100:00080000:3.0:1788869740.923930:0:3648:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e2704807800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869740.923974:0:3648:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e280138ed80 x1875765325182336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869740.924014:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325181824:0@lo:400:kworker.0 00000100:00080000:3.0:1788869740.924052:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788869740.924057:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8e2817983800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788869740.924061:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788869740.924068:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8e2817983800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869740.924070:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 588 00000100:00080000:3.0:1788869740.924110:0:3648:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e2817983800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869740.924126:0:3648:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e280138d880 x1875765325182464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869740.924137:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325181184:0@lo:400:kworker.0 00010000:00080000:3.0:1788869740.924154:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e280138c700 x1875765325181696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869740.924164:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325181696:0@lo:400:kworker.0 00000100:00100000:0.0:1788869740.926388:0:17099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875765325182080:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 52471us (52525us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788869740.926405:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788869740.928161:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765325182336:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788869740.928234:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869740.928307:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325182464:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788869740.928337:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788869740.928386:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2701f18000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869740.928391:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788869740.928395:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765325182080:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788869740.928681:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325182464 00000100:00100000:3.0:1788869740.928691:0:17103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325182464 00000100:00100000:3.0:1788869740.928737:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788869740.928746:0:17103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875765325182464:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788869740.928765:0:17103:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788869740.928814:0:17103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875765325182464:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 69us (476us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788869740.928831:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1788869740.928905:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2817983800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869740.928909:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788869740.928912:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325182464:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788869740.929059:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325182336 00000100:00100000:0.0:1788869740.929065:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325182336 00000100:00100000:2.0:1788869740.929203:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788869740.929208:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875765325182336:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788869740.929216:0:17100:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788869740.929261:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875765325182336:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 52us (1027us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788869740.929268:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1788869740.929324:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2704807800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788869740.929329:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788869740.929332:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765325182336:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1788869741.126761:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869741.385963:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869741.385989:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325182592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869741.386078:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869741.386184:0:20240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325182592 00000100:00100000:2.0:1788869741.386194:0:20240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325182592 00000100:00100000:2.0:1788869741.386254:0:20240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788869741.386265:0:20240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325182592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788869741.386301:0:20240:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788869741.386349:0:20240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325182592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869741.386369:0:20240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788869741.386677:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325182592:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788869742.154897:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869743.175163:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869744.197977:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788869744.971696:0:17078:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788869744.971710:0:17078:0:(genops.c:885:class_export_put()) final put ffff8e2807dd7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788869744.971959:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2807dd7000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788869744.972631:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e282d8ca000 for lustre-MDT0000 00000001:00100000:2.0:1788869744.973348:0:19421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788869744.973355:0:19421:0:(genops.c:885:class_export_put()) final put ffff8e282daf6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788869744.973751:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282daf6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000001:00100000:1.0:1788869744.974160:0:18601:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788869744.974167:0:18601:0:(genops.c:885:class_export_put()) final put ffff8e2827a92000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788869744.978188:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e282daf2800 for lustre-OST0001 00000020:00000080:0.0:1788869744.978611:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2827a92000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788869744.978674:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2827a96800 for lustre-OST0000 00000001:00100000:3.0:1788869744.984838:0:17831:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788869744.984862:0:17831:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1788869744.984869:0:17831:0:(genops.c:885:class_export_put()) final put ffff8e281127a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788869744.984983:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e281127a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788869744.985074:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e280a6c2000 for lustre-MDT0001 00000020:01000000:2.0:1788869745.094875:0:20673:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2701f28a80 - data ffff8e2831f0d288/ffff8e2825cfdc00 00000020:01000000:2.0:1788869745.095115:0:20673:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e283cc560c0 - data ffff8e2831e52000/ffff8e283d3ef800 00000001:00000004:2.0:1788869745.109001:0:20673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00080000:3.0:1788869745.167305:0:20673:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788869745.167318:0:20673:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788869745.167350:0:20673:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8e282f047b80 x1875765325180544/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788869748 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869745.167413:0:20673:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788869745.174486:0:20673:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788869745.174500:0:20673:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1788869745.176155:0:20673:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788869745.176166:0:20673:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788869745.181067:0:17122:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788869745.181080:0:17122:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:0.0:1788869745.181102:0:17122:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788869745.181931:0:20673:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788869745.181939:0:20673:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1788869745.181962:0:20673:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788869745.181965:0:20673:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788869745.183212:0:17124:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788869745.183219:0:17124:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:0.0:1788869745.183234:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788869745.186675:0:20673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cf9bb 00000020:00000080:3.0:1788869745.186693:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e2840c4c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788869745.187762:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840c4c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788869745.190480:0:20673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cf9d0 00000020:00000080:3.0:1788869745.190499:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e2840c4a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788869745.190521:0:20673:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788869745.190528:0:20673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869745.190539:0:20673:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788869745.190544:0:20673:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8e2840a3b380) has no exports 00000004:01000000:3.0:1788869745.190953:0:20673:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788869745.190967:0:20673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfa32 00000020:00000080:3.0:1788869745.190972:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e2703be8800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788869745.190977:0:20673:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788869745.190982:0:20673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869745.190988:0:20673:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788869745.190991:0:20673:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8e2840d80000) has no exports 00000020:00000080:3.0:1788869745.190999:0:20673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfa2b 00000020:00000080:3.0:1788869745.191003:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e282db3c000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788869745.191464:0:20673:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788869745.191471:0:20673:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788869745.191477:0:20673:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1788869745.191485:0:20673:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788869745.191488:0:20673:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788869745.191541:0:20673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869745.191548:0:20673:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788869745.191561:0:20673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfa1d 00000020:00000080:3.0:1788869745.191567:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e2840c4b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788869745.191571:0:20673:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788869745.191575:0:20673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869745.191578:0:20673:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788869745.191581:0:20673:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8e27025eb380) has no exports 00000020:00000080:3.0:1788869745.191622:0:20673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfa16 00000020:00000080:3.0:1788869745.191626:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e282a39f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788869745.192655:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840c4a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788869745.192673:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2703be8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788869745.192679:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282db3c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788869745.192686:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e282db3e000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788869745.192696:0:475:0:(genops.c:885:class_export_put()) final put ffff8e2840c4f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788869745.192699:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840c4f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788869745.192707:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788869745.192836:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840c4b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788869745.192842:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282a39f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788869745.195302:0:20673:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788869745.195314:0:20673:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788869745.195320:0:20673:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1788869745.195397:0:20673:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788869745.195401:0:20673:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788869745.197681:0:20673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869745.197705:0:20673:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788869745.197729:0:20673:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788869745.197740:0:20673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfa08 00000020:00000080:3.0:1788869745.197765:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e282a39b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788869745.202455:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e282a39b800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788869745.202484:0:475:0:(genops.c:885:class_export_put()) final put ffff8e282a39d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788869745.202488:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282a39d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788869745.202499:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788869745.203212:0:20673:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788869745.203412:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282a39b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788869745.204651:0:20673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788869745.204670:0:20673:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788869745.204675:0:20673:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff8e2840d83380) has no exports 00000020:00000080:0.0:1788869745.204686:0:20673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfa01 00000020:00000080:0.0:1788869745.204697:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e2704142800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788869745.206269:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2704142800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788869745.206507:0:20673:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788869745.206514:0:20673:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788869745.206520:0:20673:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788869745.206529:0:20673:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788869745.206612:0:20673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869745.206624:0:20673:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788869745.206660:0:20673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869745.206663:0:20673:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788869745.206670:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e2840c49000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788869745.206673:0:20673:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840c49000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788869745.206684:0:20673:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788869745.206847:0:20673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cf9d7 00000020:00000080:1.0:1788869745.206856:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e2840c4b800/lustre-MDD0000_UUID 00000020:01000000:1.0:1788869745.206864:0:20673:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788869745.206869:0:20673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869745.206875:0:20673:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788869745.206880:0:20673:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8e2840a38000) has no exports 00000020:00000080:1.0:1788869745.206928:0:20673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869745.206932:0:20673:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788869745.206937:0:20673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cf9de 00000020:00000080:1.0:1788869745.206942:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e2840c4c000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788869745.206955:0:20673:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e280a5b7800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788869745.206959:0:20673:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e280a5b7800 3 00000020:01000004:1.0:1788869745.206964:0:20673:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e280a5b7800 from lustre-MDT0000 00000020:00000080:1.0:1788869745.206987:0:20673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869745.206991:0:20673:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788869745.206994:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e2840c4e000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788869745.206997:0:20673:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840c4e000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788869745.207008:0:20673:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788869745.207042:0:20673:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788869745.207048:0:20673:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788869745.207052:0:20673:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788869745.207055:0:20673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869745.207058:0:20673:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788869745.207067:0:20673:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8e282a392800 71f22428-daa5-41c2-b06f-55c4031bf12e 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788869745.207073:0:20673:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8e28411e3380) has exports, disconnecting them 00000020:00080000:1.0:1788869745.207078:0:20673:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8e282a392800), last request at 1788869638 00000020:00000080:1.0:1788869745.207568:0:20673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cf983 00000020:00010000:1.0:1788869745.207574:0:20673:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e282a392800: total 2 00000100:00080000:1.0:1788869745.207580:0:20673:0:(import.c:65:import_set_state_nolock()) ffff8e282a390000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788869745.207615:0:20673:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e282a392800): rc 0 00000020:00080000:1.0:1788869745.207620:0:20673:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8e28411e3380) has no exports 00000020:00010000:1.0:1788869745.207637:0:17087:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e282a392800: total 2 00010000:00010000:1.0:1788869745.207642:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869745.207675:0:17087:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e282a392800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788869745.207709:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840ed8a00/0x4c16c38a9b6cfbe4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6cfbdd expref: 14 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869745.207730:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbb5200/0x4c16c38a9b6cfd42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6cfd3b expref: 13 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869745.207768:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840eda200/0x4c16c38a9b6cfaa2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6cfa9b expref: 12 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869745.207783:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7ee00/0x4c16c38a9b6cfc0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6cfc07 expref: 11 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869745.207796:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2842043e00/0x4c16c38a9b6cff3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6cff33 expref: 10 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869745.207808:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7f400/0x4c16c38a9b6cfb5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6cfb58 expref: 9 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869745.207820:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840ed8400/0x4c16c38a9b6cfab0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6cfaa9 expref: 8 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869745.207833:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840ed8000/0x4c16c38a9b6cf991 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6cf98a expref: 7 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869745.207845:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6cff2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6cff25 expref: 6 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869745.207856:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7f800/0x4c16c38a9b6cff48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6cff41 expref: 5 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869745.207868:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6cfabe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6cfab7 expref: 4 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869745.207879:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7fa00/0x4c16c38a9b6cfd6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6cfd65 expref: 3 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869745.207906:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28029d7a00/0x4c16c38a9b6cfdab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4c16c38a9b6cfda4 expref: 2 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869745.207920:0:17087:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e282a392800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788869745.207936:0:17087:0:(genops.c:885:class_export_put()) final put ffff8e282a392800/71f22428-daa5-41c2-b06f-55c4031bf12e 00010000:00010000:1.0:1788869745.207943:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869745.207945:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869745.207947:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869745.208027:0:17093:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8e2840ef7600:17093] 2 exiting: rc = 0 00000100:00100000:1.0:1788869745.208175:0:17092:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8e2840ef6c00:17092] 1 exiting: rc = 0 00000100:00100000:3.0:1788869745.208776:0:17091:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8e2817991a00:17091] 0 exiting: rc = 1 00000020:00000080:3.0:1788869745.208849:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2704140800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788869745.208860:0:8:0:(genops.c:885:class_export_put()) final put ffff8e2704140000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788869745.208864:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2704140000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788869745.208869:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788869745.208956:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840c4b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788869745.208961:0:8:0:(genops.c:885:class_export_put()) final put ffff8e2840c4e800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788869745.208974:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840c4e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788869745.208980:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788869745.209015:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840c4c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788869745.209022:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282a392800/71f22428-daa5-41c2-b06f-55c4031bf12e for MGS 00000020:00000080:3.0:1788869745.209065:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e282a390000 for MGS 00000100:00100000:1.0:1788869745.209543:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209555:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209562:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209569:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209576:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209583:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209617:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209624:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209629:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209638:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209646:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209654:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209661:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209667:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209673:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209679:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209684:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209691:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209698:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209705:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209710:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209729:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209735:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209742:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209761:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209768:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209774:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209780:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209788:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209795:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209802:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209808:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209815:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209820:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209827:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209833:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209839:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209845:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209850:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209856:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209862:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209867:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209873:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209879:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209886:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209893:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209900:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209906:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209912:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209919:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209936:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209944:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209950:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209955:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209962:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209967:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209983:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209988:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209994:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.209999:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.210006:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.210012:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.210019:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869745.210024:0:20673:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788869745.213600:0:20673:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2840ac4000 - data ffff8e2831eff6c0/ffff8e27042ac000 00000020:01000000:1.0:1788869745.213775:0:20673:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2702a03360 - data ffff8e2831e7daf8/ffff8e282f09ac00 00000020:00000080:1.0:1788869745.214319:0:20673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cf967 00000020:00000080:1.0:1788869745.214332:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e2703a18800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788869745.214351:0:20673:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e280a5b7800 from MGS, refs=2 00000020:01000004:1.0:1788869745.214355:0:20673:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e280a5b7800 2 00000020:01000004:1.0:1788869745.214360:0:20673:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e280a5b7800 from MGS 00000020:00000080:1.0:1788869745.214391:0:20673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869745.214400:0:20673:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788869745.214403:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e2703a1d000/MGS 00000020:00000080:1.0:1788869745.214406:0:20673:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2703a1d000/MGS for MGS 00000020:01000000:1.0:1788869745.214413:0:20673:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788869745.214500:0:20673:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788869745.214505:0:20673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869745.214511:0:20673:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788869745.214520:0:20673:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8e282db38000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788869745.214527:0:20673:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff8e2840d84d40) has exports, disconnecting them 00000020:00080000:1.0:1788869745.214532:0:20673:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8e282db38000), last request at 1788869639 00000020:00000080:1.0:1788869745.214536:0:20673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfa6a 00000020:00080000:1.0:1788869745.214547:0:20673:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e282db38000): rc 0 00000020:00000080:1.0:1788869745.214552:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e282db38000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788869745.215759:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2703a18800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788869745.215778:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282db38000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788869745.247207:0:20673:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788869745.247215:0:20673:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788869745.247221:0:20673:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788869745.247242:0:20673:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788869745.247675:0:20673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869745.247684:0:20673:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788869745.247692:0:20673:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e280a5b7800 1 00000020:00000080:1.0:1788869745.247699:0:20673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cf959 00000020:00000080:1.0:1788869745.247708:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e2703a1b800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788869745.247714:0:20673:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788869745.247719:0:20673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869745.247722:0:20673:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788869745.247726:0:20673:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8e27025ecd40) has no exports 00000020:00000080:3.0:1788869745.249666:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e280a6c0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788869745.249682:0:475:0:(genops.c:885:class_export_put()) final put ffff8e282db3e800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788869745.249685:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282db3e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788869745.249698:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788869745.249804:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2703a1b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788869745.331891:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788869745.474054:0:20673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869745.474073:0:20673:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788869745.474081:0:20673:0:(genops.c:885:class_export_put()) final put ffff8e280a5b5800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788869745.474087:0:20673:0:(genops.c:844:class_export_destroy()) destroying export ffff8e280a5b5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788869745.474103:0:20673:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788869745.474918:0:20673:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e280a5b0000 00000020:02000400:0.0:1788869745.475029:0:20673:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1788869745.993998:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869745.994023:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325182720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869745.994095:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869745.994165:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325182720 00000100:00100000:2.0:1788869745.994174:0:18608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325182720 00000100:00100000:2.0:1788869745.994233:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788869745.994237:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869745.994244:0:18608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325182720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788869745.994275:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788869745.994319:0:18608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325182720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869745.994326:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788869745.994371:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325182720:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788869745.996259:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788869745.996266:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788869745.996270:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e2817983800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869745.996277:0:475:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 674 00000100:00080000:1.0:1788869745.996282:0:475:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788869745.996293:0:475:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e2817983800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869745.996319:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27038e9180 x1875765325182976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788869745.996353:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788869745.996357:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788869745.996359:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e2701f18000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869745.996362:0:475:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 674 00000100:00080000:1.0:1788869745.996365:0:475:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788869745.996369:0:475:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e2701f18000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869745.996382:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27038e9880 x1875765325183232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788869745.996413:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788869745.996417:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788869745.996418:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e282db38800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869745.996423:0:475:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 674 00000100:00080000:1.0:1788869745.996425:0:475:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788869745.996431:0:475:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e282db38800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869745.996444:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27038e8000 x1875765325183360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788869745.996463:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788869745.996466:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788869745.996468:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e2704807800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869745.996472:0:475:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 674 00000100:00080000:1.0:1788869745.996475:0:475:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788869745.996479:0:475:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e2704807800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869745.996490:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27038eb480 x1875765325183616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869745.996526:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325182976:0@lo:38:kworker.0 00000100:00100000:1.0:1788869745.996607:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869745.996639:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765325183232:0@lo:38:kworker.0 00000100:00100000:1.0:1788869745.996666:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869745.996684:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765325183360:0@lo:38:kworker.0 00000100:00100000:1.0:1788869745.996704:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869745.996720:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765325183616:0@lo:38:kworker.0 00000100:00100000:1.0:1788869745.996767:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869745.996815:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325183488:0@lo:400:kworker.0 00000100:00100000:1.0:1788869745.996841:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869745.996859:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869745.996864:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325183104:0@lo:400:kworker.0 00000100:00100000:1.0:1788869745.996889:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869745.996926:0:18122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325182976 00000100:00100000:1.0:1788869745.996933:0:18122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325182976 00000100:00100000:1.0:1788869745.996969:0:18122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788869745.996976:0:18122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1875765325182976:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788869745.996996:0:18122:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788869745.999088:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325183232 00000100:00100000:2.0:1788869745.999102:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325183232 00000100:00100000:2.0:1788869745.999133:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325183360 00000100:00100000:2.0:1788869745.999137:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325183360 00000100:00100000:2.0:1788869745.999159:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325183616 00000100:00100000:2.0:1788869745.999162:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325183616 00000100:00100000:2.0:1788869745.999169:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325183488 00000100:00100000:2.0:1788869745.999172:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325183488 00000100:00100000:2.0:1788869745.999217:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788869745.999228:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325183488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869745.999322:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325183488:12345-0@lo:400:kworker.0 Request processed in 97us (2480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869745.999329:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788869745.999345:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788869745.999349:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875765325183232:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788869745.999365:0:17100:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788869745.999400:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875765325183232:12345-0@lo:38:kworker.0 Request processed in 50us (2734us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788869745.999407:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788869745.999418:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788869745.999421:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875765325183360:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788869745.999431:0:17100:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788869745.999454:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875765325183360:12345-0@lo:38:kworker.0 Request processed in 31us (2749us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788869745.999460:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788869745.999471:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788869745.999475:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875765325183616:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788869745.999484:0:17100:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788869745.999507:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875765325183616:12345-0@lo:38:kworker.0 Request processed in 30us (2739us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788869745.999522:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1788869745.999540:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788869745.999574:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8e27038e8a80 x1875765325183488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869745.999619:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325183488:0@lo:400:kworker.0 00000100:00080000:2.0:1788869745.999655:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2701f18000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869745.999660:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788869745.999663:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765325183232:0@lo:38:kworker.0 00000100:00080000:2.0:1788869745.999672:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282db38800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869745.999675:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788869745.999678:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765325183360:0@lo:38:kworker.0 00000100:00080000:2.0:1788869745.999685:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2704807800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869745.999688:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788869745.999691:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765325183616:0@lo:38:kworker.0 00000100:00100000:3.0:1788869745.999782:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325183744:0@lo:400:kworker.0 00000100:00100000:3.0:1788869745.999825:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869745.999853:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869745.999861:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325182848:0@lo:400:kworker.0 00000400:00000100:3.0:1788869745.999881:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765325182848 offset 0 length 224: 4 00000100:00100000:3.0:1788869745.999917:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325183744 00000100:00100000:3.0:1788869745.999921:0:17100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325183744 00000100:00100000:3.0:1788869745.999956:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788869745.999963:0:17100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325183744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869746.000002:0:17100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325183744:12345-0@lo:400:kworker.0 Request processed in 40us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869746.000009:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1788869746.000026:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788869746.000055:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8e27038e9c00 x1875765325183744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869746.000066:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325183744:0@lo:400:kworker.0 00000100:00100000:0.0:1788869746.001981:0:18991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325183104 00000100:00100000:0.0:1788869746.001996:0:18991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325183104 00000100:00100000:0.0:1788869746.002074:0:18991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788869746.002085:0:18991:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325183104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869746.002174:0:18991:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325183104:12345-0@lo:400:kworker.0 Request processed in 92us (5283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869746.002181:0:18991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788869746.002202:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869746.002241:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325183104:0@lo:400:kworker.0 00000100:00100000:1.0:1788869746.039282:0:18122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1875765325182976:12345-0@lo:38:kworker.0 Request processed in 42297us (42686us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788869746.039297:0:18122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1788869746.039990:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2817983800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869746.039996:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788869746.040007:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325182976:0@lo:38:kworker.0 00010000:00010000:2.0:1788869746.374801:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869746.508397:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869746.512932:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325183872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869746.513263:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869746.513392:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325183872 00000100:00100000:3.0:1788869746.513402:0:18609:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325183872 00000100:00100000:3.0:1788869746.513583:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788869746.513616:0:18609:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325183872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788869746.513649:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788869746.513701:0:18609:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325183872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869746.513708:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788869746.513961:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325183872:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1788869746.760517:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788869747.401735:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869748.424829:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788869749.388469:0:20874:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788869749.415871:0:20874:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788869749.415935:0:20874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6cfb58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfb5f expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869749.415952:0:20874:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6cfb58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfb5f expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869749.415960:0:20874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6cfb58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cfb5f expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869749.415988:0:20874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6cfb58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cfb5f expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869749.416010:0:20874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788869749.416016:0:20874:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788869749.416048:0:20874:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788869749.416067:0:20874:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788869749.416074:0:20874:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788869749.416081:0:20874:0:(import.c:65:import_set_state_nolock()) ffff8e2701f18000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788869749.416086:0:20874:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788869749.416088:0:20874:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788869749.416091:0:20874:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788869749.417052:0:20874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6cfab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfabe expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869749.417067:0:20874:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6cfab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfabe expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869749.417074:0:20874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6cfab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cfabe expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869749.417080:0:20874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6cfab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cfabe expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869749.417106:0:20874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788869749.417113:0:20874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6cfda4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfdab expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869749.417135:0:20874:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6cfda4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfdab expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869749.417142:0:20874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6cfda4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cfdab expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869749.417149:0:20874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6cfda4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cfdab expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869749.417157:0:20874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788869749.417164:0:20874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f000/0x4c16c38a9b6cff41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cff48 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869749.417170:0:20874:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f000/0x4c16c38a9b6cff41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cff48 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869749.417177:0:20874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f000/0x4c16c38a9b6cff41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cff48 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869749.417183:0:20874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f000/0x4c16c38a9b6cff41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cff48 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869749.417191:0:20874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788869749.417195:0:20874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6cfaa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfab0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869749.417202:0:20874:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6cfaa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfab0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869749.417219:0:20874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6cfaa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cfab0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869749.417226:0:20874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6cfaa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cfab0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869749.417235:0:20874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:1.0:1788869749.417239:0:20874:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1788869749.417289:0:20874:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1788869749.417294:0:20874:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1788869749.417299:0:20874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869749.417304:0:20874:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788869749.417312:0:20874:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8e282daf6800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788869749.417317:0:20874:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8e2840eb7000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788869749.417323:0:20874:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff8e28411e0000) has exports, disconnecting them 00000020:00080000:1.0:1788869749.417328:0:20874:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8e282daf6800), last request at 1788869745 00000020:00000080:1.0:1788869749.417335:0:20874:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfd96 00000100:00080000:1.0:1788869749.417355:0:20874:0:(import.c:65:import_set_state_nolock()) ffff8e282daf7800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788869749.417411:0:20874:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e282daf6800): rc 0 00000020:00000080:1.0:1788869749.417414:0:20874:0:(genops.c:885:class_export_put()) final put ffff8e282daf6800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1788869749.417432:0:20874:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8e2840eb7000), last request at 1788869745 00000020:00000080:1.0:1788869749.417436:0:20874:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfc38 00000100:00080000:1.0:1788869749.417443:0:20874:0:(import.c:65:import_set_state_nolock()) ffff8e2840eb4000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788869749.417450:0:20874:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2840eb7000): rc 0 00000020:00000080:1.0:1788869749.417452:0:20874:0:(genops.c:885:class_export_put()) final put ffff8e2840eb7000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1788869749.417459:0:20874:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb9f6814a3ae0 00000100:00080000:1.0:1788869749.417478:0:20874:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788869749.417488:0:20874:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788869749.418344:0:20874:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788869749.418351:0:20874:0:(import.c:65:import_set_state_nolock()) ffff8e2817983800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788869749.418508:0:20874:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788869749.418512:0:20874:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788869749.418522:0:20874:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788869749.418575:0:20874:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:3.0:1788869749.418895:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788869749.418905:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6cfb58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cfb5f expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.418915:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e200 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869749.418919:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6cfb58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cfb5f expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.418930:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6cfb58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6cfb5f expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869749.418938:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6cfb58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6cfb5f expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869749.418944:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788869749.418962:0:17087:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788869749.418966:0:17087:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788869749.418994:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6cfb58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cfb5f expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419000:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869749.419024:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6cfb58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cfb5f expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419031:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e200/0x4c16c38a9b6cfb58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cfb5f expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419044:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788869749.419047:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6cfab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cfabe expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419053:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8a00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869749.419056:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6cfab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cfabe expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419063:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6cfab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6cfabe expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869749.419070:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6cfab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6cfabe expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869749.419075:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788869749.419077:0:17087:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1788869749.419079:0:17087:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1788869749.419092:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6cfab7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cfabe expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419108:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869749.419115:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6cfab7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cfabe expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419120:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28014a8a00/0x4c16c38a9b6cfab7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cfabe expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419130:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788869749.419134:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6cfda4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cfdab expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419139:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6200 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869749.419141:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6cfda4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cfdab expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419147:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6cfda4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6cfdab expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869749.419154:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6cfda4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6cfdab expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869749.419159:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788869749.419161:0:17087:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788869749.419163:0:17087:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788869749.419175:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6cfda4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cfdab expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419181:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869749.419197:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6cfda4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cfdab expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419214:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6cfda4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cfdab expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419228:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869749.419231:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f000/0x4c16c38a9b6cff41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cff48 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419237:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f000 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869749.419240:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f000/0x4c16c38a9b6cff41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cff48 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419246:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f000/0x4c16c38a9b6cff41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6cff48 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869749.419253:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f000/0x4c16c38a9b6cff41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6cff48 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869749.419257:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788869749.419260:0:17087:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788869749.419262:0:17087:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788869749.419275:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f000/0x4c16c38a9b6cff41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cff48 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419281:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869749.419287:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f000/0x4c16c38a9b6cff41 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cff48 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419293:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840c7f000/0x4c16c38a9b6cff41 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cff48 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419311:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869749.419314:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6cfaa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cfab0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419320:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28014a8000 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869749.419323:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6cfaa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cfab0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419330:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6cfaa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6cfab0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869749.419337:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6cfaa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6cfab0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869749.419342:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788869749.419344:0:17087:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788869749.419345:0:17087:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788869749.419356:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6cfaa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cfab0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419361:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869749.419365:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6cfaa9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cfab0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419372:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28014a8000/0x4c16c38a9b6cfaa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4c16c38a9b6cfab0 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869749.419381:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869749.419383:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869749.419389:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869749.419412:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325184384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869749.419477:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869749.419539:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869749.419545:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325184512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869749.419564:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869749.419606:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325184384 00000100:00100000:3.0:1788869749.419614:0:17085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325184384 00000100:00100000:3.0:1788869749.419645:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325184512 00000100:00100000:3.0:1788869749.419647:0:17085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325184512 00000100:00100000:3.0:1788869749.419658:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869749.419680:0:17085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3648:x1875765325184384:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788869749.419686:0:17085:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788869749 with bad export cookie 5482784596450670979 00000020:00000080:0.0:1788869749.422225:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282daf6800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1788869749.422307:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840eb7000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1788869749.422333:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e282daf7800 for lustre-MDT0001 00000020:00000080:0.0:1788869749.422338:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2840eb4000 for lustre-MDT0001 00000100:00100000:0.0:1788869749.422365:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325184128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869749.422443:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869749.422478:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325184640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869749.422513:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869749.422533:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869749.422539:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325184256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869749.422557:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869749.422634:0:17084:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788869749.422645:0:17084:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788869749.422785:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325184128 00000100:00100000:0.0:1788869749.422794:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325184128 00000100:00100000:0.0:1788869749.422831:0:17084:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788869749.422837:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325184640 00000100:00100000:0.0:1788869749.422839:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325184640 00000100:00100000:0.0:1788869749.422868:0:17084:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788869749.422873:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325184256 00000100:00100000:0.0:1788869749.422875:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325184256 00000100:00100000:0.0:1788869749.422970:0:20875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788869749.422978:0:20875:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1875765325184512:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788869749.422988:0:20875:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788869749 with bad export cookie 5482784596450670979 00000100:00100000:0.0:1788869749.423049:0:20875:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1875765325184512:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (3482us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788869749.423056:0:20875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788869749.423075:0:20875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788869749.423079:0:20875:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27025f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3650:x1875765325184128:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788869749.423083:0:20875:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788869749 with bad export cookie 5482784596450670979 00000100:00100000:0.0:1788869749.423111:0:20875:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27025f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3650:x1875765325184128:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (669us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788869749.423116:0:20875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788869749.423144:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788869749.423148:0:3650:0:(import.c:65:import_set_state_nolock()) ffff8e280a5b3000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788869749.423151:0:3650:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.154@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1788869749.424073:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869749.424929:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788869749.424941:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3650:x1875765325184640:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788869749.424948:0:17083:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788869749 with bad export cookie 5482784596450670979 00000100:00100000:2.0:1788869749.425046:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3650:x1875765325184640:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (2532us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788869749.425061:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788869749.425087:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788869749.425092:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3650:x1875765325184256:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788869749.425096:0:17083:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788869749 with bad export cookie 5482784596450670979 00000100:00100000:2.0:1788869749.425123:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3650:x1875765325184256:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (2565us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788869749.425129:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788869749.425331:0:20874:0:(import.c:65:import_set_state_nolock()) ffff8e282d8cb000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788869749.425388:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325184000:0@lo:9:umount.0 00000100:00100000:2.0:1788869749.425435:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788869749.425485:0:20874:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788869749.426699:0:20874:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788869749.426724:0:20874:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788869749.426830:0:20874:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788869749.426861:0:20874:0:(import.c:65:import_set_state_nolock()) ffff8e282d8c9000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788869749.426961:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325184768:0@lo:9:umount.0 00000100:00100000:2.0:1788869749.427018:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869749.427086:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325184000 00000100:00100000:2.0:1788869749.427094:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325184000 00000100:00100000:2.0:1788869749.427153:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325184768 00000100:00100000:2.0:1788869749.427156:0:18605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325184768 00000100:00100000:2.0:1788869749.427182:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788869749.427191:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765325184000:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788869749.427215:0:18605:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfc62 00000100:00080000:2.0:1788869749.427225:0:18605:0:(import.c:65:import_set_state_nolock()) ffff8e27029d6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788869749.427270:0:18605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1788869749.427422:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3647:x1875765325184000:12345-0@lo:9:umount.0 Request processed in 232us (1986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869749.427430:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788869749.427444:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788869749.427451:0:18605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875765325184768:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788869749.427479:0:18605:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfdc7 00000100:00080000:2.0:1788869749.427485:0:18605:0:(import.c:65:import_set_state_nolock()) ffff8e282daf4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788869749.427521:0:18605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788869749.427623:0:18605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3647:x1875765325184768:12345-0@lo:9:umount.0 Request processed in 173us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869749.427630:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788869749.427648:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788869749.427652:0:17094:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788869749.427678:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788869749.427706:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282d8c9000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788869749.427715:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788869749.427716:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788869749.427720:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325184768:0@lo:9:umount.0 00000100:00080000:2.0:1788869749.427731:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282d8cb000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788869749.427738:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788869749.427740:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788869749.427742:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325184000:0@lo:9:umount.0 00000100:00080000:3.0:1788869749.430846:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:00080000:1.0:1788869749.430976:0:20874:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8e28411e0000) has no exports 00000100:00080000:0.0:1788869749.452848:0:3650:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.154@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788869749.452855:0:3650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788869749.452866:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e282db34700 x1875765325182848/t0(0) o400->MGC192.168.204.154@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788869761 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869749.452883:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e280138d500 x1875765325184384/t0(0) o103->MGC192.168.204.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788869765 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869749.452891:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e280138fb80 x1875765325184512/t0(0) o103->MGC192.168.204.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788869765 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869749.452900:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e280138c700 x1875765325184128/t0(0) o103->MGC192.168.204.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788869765 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869749.452933:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e280138c380 x1875765325184640/t0(0) o103->MGC192.168.204.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788869765 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869749.452942:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e280138e300 x1875765325184256/t0(0) o103->MGC192.168.204.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788869765 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788869749.452952:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788869749.452955:0:3650:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788869749.452956:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788869749.453459:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8e280a5b3000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788869749.453493:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325184384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869749.453502:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282db34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325182848:0@lo:400:kworker.0 00000100:00100000:3.0:1788869749.453537:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:71f22428-daa5-41c2-b06f-55c4031bf12e:3648:1875765325184512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869749.453560:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788869749.455453:0:17085:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875765325184384 offset 224 length 224: 4 00000100:00100000:3.0:1788869749.455495:0:17085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3648:x1875765325184384:12345-0@lo:103:ldlm_bl.0 Request processed in 35825us (36013us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788869749.455511:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788869749.456140:0:3650:0:(import.c:65:import_set_state_nolock()) ffff8e280a5b3000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869749.456148:0:3650:0:(import.c:545:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 572 00000100:00080000:0.0:1788869749.456161:0:3650:0:(import.c:666:import_select_connection()) MGC192.168.204.154@tcp: import ffff8e280a5b3000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869749.456396:0:3650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282f045c00 x1875765325184896/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788869749.456447:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325184640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869749.456473:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325184256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869749.456478:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:71f22428-daa5-41c2-b06f-55c4031bf12e:3650:1875765325184128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869749.456576:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:71f22428-daa5-41c2-b06f-55c4031bf12e:3647:1875765325184896:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1788869749.456641:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765325184896 offset 0 length 520: 4 00010000:00010000:2.0:1788869749.456885:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788869749.463531:0:20874:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8e28411e0000) has no exports 00000020:01000000:0.0:1788869749.530238:0:20874:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2701f28f00 - data ffff8e2831d26000/ffff8e2825cfd000 00000020:01000000:0.0:1788869749.532094:0:20874:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2811b09780 - data ffff8e2831db7870/ffff8e280587c000 00000001:00000004:0.0:1788869749.542402:0:20874:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1788869749.632444:0:20874:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788869749.632454:0:20874:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788869749.632463:0:20874:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788869749.638381:0:20874:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788869749.638392:0:20874:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788869749.638409:0:20874:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788869749.638412:0:20874:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788869749.638838:0:17839:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788869749.638844:0:17839:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1788869749.638855:0:17839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788869749.639492:0:20874:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788869749.639496:0:20874:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788869749.639513:0:20874:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788869749.639515:0:20874:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788869749.640199:0:17841:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788869749.640204:0:17841:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1788869749.640213:0:17841:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788869749.641286:0:20874:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfacc 00000020:00000080:3.0:1788869749.641298:0:20874:0:(genops.c:885:class_export_put()) final put ffff8e2817987800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788869749.641427:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2817987800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788869749.642379:0:20874:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfae1 00000020:00000080:3.0:1788869749.642386:0:20874:0:(genops.c:885:class_export_put()) final put ffff8e27029d3800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788869749.642404:0:20874:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788869749.642413:0:20874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869749.642422:0:20874:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788869749.642427:0:20874:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8e28411e19c0) has no exports 00000020:00000080:1.0:1788869749.642430:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e27029d3800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:3.0:1788869749.642976:0:20874:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788869749.642988:0:20874:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfb35 00000020:00000080:3.0:1788869749.642993:0:20874:0:(genops.c:885:class_export_put()) final put ffff8e2809ecb800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788869749.643011:0:20874:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788869749.643016:0:20874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869749.643021:0:20874:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788869749.643023:0:20874:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8e283d3e4d40) has no exports 00000020:00000080:3.0:1788869749.643030:0:20874:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfb2e 00000020:00000080:3.0:1788869749.643034:0:20874:0:(genops.c:885:class_export_put()) final put ffff8e282d8ca800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788869749.643049:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2809ecb800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788869749.643055:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282d8ca800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788869749.646332:0:20874:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788869749.646341:0:20874:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788869749.646346:0:20874:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788869749.646354:0:20874:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788869749.646371:0:20874:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788869749.646513:0:20874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869749.646527:0:20874:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788869749.646534:0:20874:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfb20 00000020:00000080:3.0:1788869749.646543:0:20874:0:(genops.c:885:class_export_put()) final put ffff8e282d8cf800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788869749.646568:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e282d8c9000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788869749.646577:0:475:0:(genops.c:885:class_export_put()) final put ffff8e282d8cc000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788869749.646580:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282d8cc000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788869749.653562:0:20874:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788869749.653579:0:20874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869749.653605:0:20874:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788869749.653612:0:20874:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8e283d3e0000) has no exports 00000020:00000080:3.0:1788869749.653623:0:20874:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfb12 00000020:00000080:3.0:1788869749.653632:0:20874:0:(genops.c:885:class_export_put()) final put ffff8e282d8c8800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788869749.654581:0:20874:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788869749.654606:0:20874:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788869749.654611:0:20874:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788869749.654619:0:20874:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788869749.654622:0:20874:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788869749.654741:0:20874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869749.654753:0:20874:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788869749.654775:0:20874:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788869749.654783:0:20874:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfb04 00000020:00000080:3.0:1788869749.654792:0:20874:0:(genops.c:885:class_export_put()) final put ffff8e27029d1000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788869749.654798:0:20874:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788869749.654813:0:20874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869749.654818:0:20874:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788869749.654822:0:20874:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8e28179f8000) has no exports 00000020:00000080:3.0:1788869749.654828:0:20874:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfafd 00000020:00000080:3.0:1788869749.654831:0:20874:0:(genops.c:885:class_export_put()) final put ffff8e27029d0000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788869749.657382:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788869749.657507:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282d8cf800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788869749.657517:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282d8c8800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788869749.657523:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e282d8cb000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788869749.657549:0:475:0:(genops.c:885:class_export_put()) final put ffff8e28130f4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788869749.657552:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e28130f4000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788869749.657555:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788869749.657606:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e27029d1000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788869749.657612:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e27029d0000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788869749.677749:0:20874:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1788869749.677759:0:20874:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788869749.677764:0:20874:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788869749.677773:0:20874:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788869749.677978:0:20874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869749.678005:0:20874:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788869749.678045:0:20874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869749.678049:0:20874:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788869749.678056:0:20874:0:(genops.c:885:class_export_put()) final put ffff8e2817987000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788869749.678062:0:20874:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2817987000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788869749.678091:0:20874:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788869749.678359:0:20874:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfae8 00000020:00000080:3.0:1788869749.678369:0:20874:0:(genops.c:885:class_export_put()) final put ffff8e27029d6800/lustre-MDD0001_UUID 00000020:00000080:0.0:1788869749.678463:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2817983800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788869749.678471:0:8:0:(genops.c:885:class_export_put()) final put ffff8e27029d0800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788869749.678473:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e27029d0800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1788869749.678489:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788869749.678886:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e27029d6800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788869749.678921:0:20874:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788869749.678927:0:20874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869749.678935:0:20874:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788869749.678940:0:20874:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8e28411e4d40) has no exports 00000020:00000080:3.0:1788869749.679019:0:20874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869749.679025:0:20874:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788869749.679029:0:20874:0:(genops.c:885:class_export_put()) final put ffff8e2817980000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788869749.679032:0:20874:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2817980000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788869749.679035:0:20874:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788869749.679233:0:20874:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfaef 00000020:00000080:3.0:1788869749.679311:0:20874:0:(genops.c:885:class_export_put()) final put ffff8e27029d7800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1788869749.679333:0:20874:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e282dac7800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1788869749.679337:0:20874:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e282dac7800 2 00000020:01000004:3.0:1788869749.679341:0:20874:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e282dac7800 from lustre-MDT0001 00000020:00000080:3.0:1788869749.679360:0:20874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869749.679365:0:20874:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788869749.679367:0:20874:0:(genops.c:885:class_export_put()) final put ffff8e2817981800/lustre-MDT0001_UUID 00000020:00000080:3.0:1788869749.679369:0:20874:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2817981800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788869749.679378:0:20874:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788869749.679404:0:20874:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788869749.679408:0:20874:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1788869749.679410:0:20874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869749.679413:0:20874:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788869749.679421:0:20874:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8e2811279800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788869749.679434:0:20874:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff8e283b578000) has exports, disconnecting them 00000020:00080000:3.0:1788869749.679438:0:20874:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8e2811279800), last request at 1788869654 00000020:00000080:3.0:1788869749.679443:0:20874:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfb6d 00000020:00080000:3.0:1788869749.679450:0:20874:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2811279800): rc 0 00000020:00000080:3.0:1788869749.679454:0:20874:0:(genops.c:885:class_export_put()) final put ffff8e2811279800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788869749.679679:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e27029d7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788869749.679686:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2811279800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788869749.680508:0:20874:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788869749.680514:0:20874:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788869749.680519:0:20874:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788869749.680525:0:20874:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788869749.680774:0:20874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869749.680782:0:20874:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788869749.680788:0:20874:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e282dac7800 1 00000020:00000080:3.0:1788869749.680794:0:20874:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfa94 00000020:00000080:3.0:1788869749.680811:0:20874:0:(genops.c:885:class_export_put()) final put ffff8e2817534800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788869749.680946:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2701f18000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788869749.680962:0:8:0:(genops.c:885:class_export_put()) final put ffff8e2811278000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788869749.680965:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2811278000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1788869749.680971:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:3.0:1788869749.681367:0:20874:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788869749.681373:0:20874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869749.681379:0:20874:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788869749.681382:0:20874:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8e283d3e3380) has no exports 00000020:00000080:0.0:1788869749.687920:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2817534800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788869749.780047:0:20874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869749.780139:0:20874:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788869749.780146:0:20874:0:(genops.c:885:class_export_put()) final put ffff8e282da78000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788869749.780151:0:20874:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282da78000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788869749.780164:0:20874:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788869749.780361:0:20874:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e282da7a800 00000020:01000000:0.0:1788869749.780382:0:20874:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788869749.780386:0:20874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788869749.780391:0:20874:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788869749.780394:0:20874:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8e2840d819c0) has no exports 00000100:00100000:2.0:1788869749.781012:0:19213:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8e28092d5600:19213] 3 exiting: rc = 0 00000100:00100000:2.0:1788869749.781357:0:17098:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8e27029c7a00:17098] 0 exiting: rc = 1 00000100:00100000:3.0:1788869749.786003:0:17100:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8e27029c6c00:17100] 2 exiting: rc = 0 00000100:00100000:0.0:1788869749.788681:0:17099:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8e27029c7c00:17099] 1 exiting: rc = 0 00000100:00100000:2.0:1788869749.789457:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789471:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789476:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789482:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789488:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789494:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789499:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789505:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789510:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789515:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789534:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789539:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789545:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789550:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789555:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789561:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789566:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789571:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789655:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789673:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789679:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789686:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789692:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789698:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789704:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789711:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789716:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789722:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789727:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789733:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789737:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789743:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789749:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789754:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789760:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789765:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789771:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789777:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789782:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789788:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789795:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789801:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789807:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789813:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789818:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789833:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789839:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789844:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789849:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789855:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789860:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789865:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789870:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789876:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789882:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789888:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789896:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789901:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789908:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789913:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789919:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789926:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789932:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.789938:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.793997:0:17102:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8e282a384c00:17102] 1 exiting: rc = 0 00000100:00100000:2.0:1788869749.794075:0:17101:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8e2840ef6000:17101] 0 exiting: rc = 1 00000100:00100000:3.0:1788869749.794445:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794454:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794461:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794469:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794475:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794480:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794486:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794491:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794496:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794501:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794506:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794524:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794529:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794534:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794539:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794544:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794549:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794558:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794564:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794569:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794574:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794579:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794609:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794616:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794621:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794626:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794632:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794637:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794643:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794648:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794653:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794672:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794677:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794682:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794687:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794692:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794696:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794701:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794706:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794712:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794717:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794723:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794730:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.794735:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.795203:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.795217:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.795232:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.795313:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.795321:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.795327:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.795332:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.795338:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.795344:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.795349:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.795355:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.795360:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.795366:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.795371:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.795376:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.795381:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.795387:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.795392:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.795405:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.795412:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.798225:0:17104:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8e2701f00600:17104] 1 exiting: rc = 0 00000100:00100000:2.0:1788869749.798416:0:17103:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8e2817991e00:17103] 0 exiting: rc = 1 00000100:00100000:0.0:1788869749.798451:0:18122:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff8e283cd9ea00:18122] 2 exiting: rc = 0 00000100:00100000:2.0:1788869749.800562:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.800573:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.800828:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.800837:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.800843:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.800850:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.800855:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.800862:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.800869:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.800876:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.800898:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.800905:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.800911:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.800917:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.800935:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.800942:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.800949:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801147:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801158:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801164:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801171:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801176:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801198:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801205:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801211:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801217:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801223:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801228:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801233:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801239:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801246:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801252:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801257:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801263:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801410:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801418:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801424:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801431:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801438:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801443:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801449:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801455:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801460:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801465:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801471:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801476:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801495:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801503:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801508:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801522:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801528:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801535:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801543:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801550:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801555:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801561:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801567:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.801572:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.802254:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.802378:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.802389:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.802395:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.802400:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.802417:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869749.820512:0:17106:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8e282d9ce000:17106] 1 exiting: rc = 0 00000100:00100000:0.0:1788869749.820768:0:17105:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8e282d9cfc00:17105] 0 exiting: rc = 1 00000100:00100000:3.0:1788869749.822121:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822132:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822137:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822142:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822147:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822152:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822157:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822162:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822168:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822174:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822180:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822186:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822192:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822198:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822203:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822209:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822231:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822435:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822444:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822449:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822453:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822458:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822463:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822467:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822472:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822477:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822482:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822487:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822492:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822497:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822501:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822507:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822511:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822516:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822522:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822528:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822533:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822538:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822543:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822548:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822553:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822558:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822563:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822568:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822573:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822578:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822583:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822712:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822718:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822723:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822728:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822878:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822886:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822892:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822898:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822903:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822909:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822914:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822919:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822925:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822930:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822935:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822940:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869749.822945:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.823999:0:17107:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8e282a384800:17107] 0 exiting: rc = 1 00000100:00100000:0.0:1788869749.824521:0:17108:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8e2701f00c00:17108] 1 exiting: rc = 0 00000100:00100000:2.0:1788869749.824695:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824702:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824707:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824712:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824718:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824722:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824728:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824734:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824748:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824754:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824759:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824764:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824769:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824774:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824779:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824785:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824790:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824795:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824810:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824830:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824835:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824841:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824846:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824851:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824856:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824862:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824867:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824872:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824877:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824883:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824889:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824894:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824899:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824904:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824908:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824913:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824918:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824923:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824929:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824934:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824938:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824944:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824949:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824954:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824959:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824964:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824969:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824974:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824978:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824983:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824987:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824992:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.824997:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.825002:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.825016:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.825021:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.825025:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.825030:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.825035:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.825040:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.825044:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.825049:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.825054:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.825377:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.825809:0:17110:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8e2701f01a00:17110] 1 exiting: rc = 0 00000100:00100000:0.0:1788869749.825896:0:17109:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8e2701f00000:17109] 0 exiting: rc = 1 00000100:00100000:2.0:1788869749.826038:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826045:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826050:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826067:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826080:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826087:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826092:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826097:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826102:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826107:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826112:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826117:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826122:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826127:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826133:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826138:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826144:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826148:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826152:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826157:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826162:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826167:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826172:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826178:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826182:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826201:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826205:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826210:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826215:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826219:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826224:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826229:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826234:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826441:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826447:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826453:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826458:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826463:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826468:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826473:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826478:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826482:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826488:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826493:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826498:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826503:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826509:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826514:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826518:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826523:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826528:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826533:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826539:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826544:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826550:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826555:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826560:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826565:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826569:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826574:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826618:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826624:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826629:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869749.826634:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.827561:0:17111:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8e2840c5b600:17111] 0 exiting: rc = 1 00000100:00100000:2.0:1788869749.827982:0:17112:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8e2701e62400:17112] 1 exiting: rc = 0 00000100:00100000:1.0:1788869749.829443:0:17113:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8e2840fdbe00:17113] 2 exiting: rc = 0 00000100:00100000:0.0:1788869749.830784:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830795:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830811:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830830:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830836:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830843:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830848:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830854:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830861:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830868:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830874:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830880:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830885:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830891:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830897:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830902:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830909:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830915:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830942:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830949:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830955:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830960:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830967:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830973:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830978:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830985:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830991:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.830997:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831002:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831007:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831014:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831020:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831026:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831031:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831036:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831042:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831049:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831054:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831207:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831214:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831219:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831225:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831364:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831372:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831378:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831383:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831388:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831395:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831401:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831406:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831412:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831420:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831425:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831430:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831437:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831443:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831448:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831455:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831462:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831467:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831473:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831480:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831485:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869749.831490:0:20874:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788869749.841207:0:20874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869749.841222:0:20874:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788869749.841228:0:20874:0:(genops.c:885:class_export_put()) final put ffff8e2703ae9800/MDS_uuid 00000020:00000080:0.0:1788869749.841233:0:20874:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2703ae9800/MDS_uuid for MDS 00000020:01000000:0.0:1788869749.841387:0:20874:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788869749.841580:0:20874:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788869750.469839:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788869751.109740:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) 71f22428-daa5-41c2-b06f-55c4031bf12e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788869751.109752:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) 71f22428-daa5-41c2-b06f-55c4031bf12e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869751.109755:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788869751.109759:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788869751.109763:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e282db38800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869751.109775:0:475:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 679 00000100:00080000:2.0:1788869751.109781:0:475:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788869751.109796:0:475:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e282db38800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869751.109848:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e270402d500 x1875765325185024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869751.109959:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788869751.109963:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788869751.109965:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e2704807800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869751.109969:0:475:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 679 00000100:00080000:2.0:1788869751.109972:0:475:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788869751.109977:0:475:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e2704807800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869751.109992:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e270402ce00 x1875765325185280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869751.110057:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325185152:0@lo:400:kworker.0 00000400:00000100:2.0:1788869751.110112:0:3651:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325185152 offset 0 length 224: 4 00000100:00100000:1.0:1788869751.110221:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765325185024:0@lo:38:kworker.0 00000400:00000100:1.0:1788869751.110247:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325185024 offset 0 length 520: 4 00000100:00100000:1.0:1788869751.110278:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765325185280:0@lo:38:kworker.0 00000400:00000100:1.0:1788869751.110294:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325185280 offset 0 length 520: 4 00000100:00100000:3.0:1788869751.110298:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325185408:0@lo:400:kworker.0 00000400:00000100:3.0:1788869751.110320:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325185408 offset 0 length 224: 4 00010000:00010000:2.0:1788869751.493821:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869752.518942:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869753.544130:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788869754.117739:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 71f22428-daa5-41c2-b06f-55c4031bf12e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788869754.117751:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 71f22428-daa5-41c2-b06f-55c4031bf12e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869754.117754:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788869754.117758:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869754.117821:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788869754.117826:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788869754.117890:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325185664:0@lo:400:kworker.0 00000400:00000100:3.0:1788869754.117948:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325185664 offset 0 length 224: 4 00000100:00100000:2.0:1788869754.118107:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765325185536:0@lo:400:kworker.0 00000400:00000100:2.0:1788869754.118131:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325185536 offset 0 length 224: 4 00000020:01000004:0.0:1788869754.125201:0:21076:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788869754.152787:0:21076:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788869754.152847:0:21076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6cfc07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfc0e expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869754.152862:0:21076:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6cfc07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfc0e expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869754.152870:0:21076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6cfc07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cfc0e expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869754.152877:0:21076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6cfc07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cfc0e expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869754.152901:0:21076:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788869754.152907:0:21076:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788869754.152941:0:21076:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788869754.152965:0:21076:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e270402d500 x1875765325185024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788869771 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869754.152980:0:21076:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788869754.152985:0:21076:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788869754.152991:0:21076:0:(import.c:65:import_set_state_nolock()) ffff8e282db38800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788869754.152996:0:21076:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788869754.152999:0:21076:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e270402d500 x1875765325185024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788869771 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869754.153005:0:21076:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788869754.153024:0:21076:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00010000:00010000:3.0:1788869754.153176:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869754.153184:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6cfc07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cfc0e expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869754.153202:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edaa00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869754.153206:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6cfc07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cfc0e expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869754.153214:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6cfc07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6cfc0e expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869754.153221:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6cfc07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6cfc0e expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869754.153227:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788869754.153229:0:17087:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788869754.153232:0:17087:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788869754.153247:0:17087:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e280a5b3000 00010000:00010000:3.0:1788869754.153251:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6cfc07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6cfc0e expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869754.153257:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6cfc07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6cfc0e expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869754.153269:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869754.153271:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869754.153272:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869754.153306:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765325185024:0@lo:38:kworker.0 00000100:00080000:2.0:1788869754.154973:0:21076:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788869754.154991:0:21076:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e270402f480 x1875765325185152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869767 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869754.155019:0:21076:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e280138d880 x1875765325185536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869770 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869754.155037:0:21076:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788869754.155043:0:21076:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788869754.155069:0:21076:0:(import.c:65:import_set_state_nolock()) ffff8e2804fbd000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788869754.155116:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765325185536:0@lo:400:kworker.0 00000100:00100000:3.0:1788869754.155328:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325185152:0@lo:400:kworker.0 00000100:00100000:3.0:1788869754.155364:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765325185792:0@lo:39:umount.0 00000400:00000100:3.0:1788869754.155428:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325185792 offset 0 length 224: 4 00010000:00010000:3.0:1788869754.566866:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788869755.207494:0:18601:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788869755.207506:0:18601:0:(genops.c:885:class_export_put()) final put ffff8e27029d1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788869755.207910:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e27029d1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788869755.208282:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e27029d6000 for lustre-OST0000 00000001:00100000:2.0:1788869755.208412:0:19421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788869755.208418:0:19421:0:(genops.c:885:class_export_put()) final put ffff8e282daf7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788869755.211408:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282daf7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788869755.211498:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e282daf4000 for lustre-OST0001 00010000:00010000:3.0:1788869755.590573:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788869756.165662:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) 71f22428-daa5-41c2-b06f-55c4031bf12e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788869756.165676:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) 71f22428-daa5-41c2-b06f-55c4031bf12e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869756.165679:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788869756.165683:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788869756.165825:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325185920:0@lo:400:kworker.0 00000400:00000100:2.0:1788869756.165885:0:3651:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325185920 offset 0 length 224: 4 00010000:00010000:3.0:1788869756.613821:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869757.637864:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869758.671741:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869759.301785:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869749/real 1788869749] req@ffff8e282f045c00 x1875765325184896/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788869759 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869759.301831:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e282f045c00 x1875765325184896/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788869759 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788869759.301853:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e280a5b3000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788869759.301877:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788869759.301881:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:71f22428-daa5-41c2-b06f-55c4031bf12e:3647:1875765325184896:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1788869759.302482:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 71f22428-daa5-41c2-b06f-55c4031bf12e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788869759.302489:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788869759.302492:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e280a5b3000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869759.302498:0:8:0:(import.c:545:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 683 00000100:00080000:2.0:1788869759.302507:0:8:0:(import.c:630:import_select_connection()) MGC192.168.204.154@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788869759.302521:0:8:0:(import.c:666:import_select_connection()) MGC192.168.204.154@tcp: import ffff8e280a5b3000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869759.302572:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e270402d880 x1875765325186048/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869759.302665:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:71f22428-daa5-41c2-b06f-55c4031bf12e:3647:1875765325186048:0@lo:250:kworker.0 00000400:00000100:3.0:1788869759.302714:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875765325186048 offset 0 length 520: 4 00000100:00080000:2.0:1788869759.302781:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788869759.302785:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788869759.302865:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325186176:0@lo:400:kworker.0 00000400:00000100:1.0:1788869759.302899:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325186176 offset 0 length 224: 4 00010000:00010000:3.0:1788869759.685882:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869760.709939:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869761.733809:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869762.758022:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869763.782347:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869764.423165:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869754/real 1788869754] req@ffff8e270402c380 x1875765325185792/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788869764 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869764.423204:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e270402c380 x1875765325185792/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788869764 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788869764.423225:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2804fbd000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788869764.423240:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765325185792:0@lo:39:umount.0 00000100:00080000:2.0:1788869764.423484:0:21076:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788869764.423505:0:21076:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788869764.423509:0:21076:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788869764.424509:0:21076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6cfbdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfbe4 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869764.424525:0:21076:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6cfbdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfbe4 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869764.424533:0:21076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6cfbdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cfbe4 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869764.424541:0:21076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6cfbdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cfbe4 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869764.424574:0:21076:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869764.424582:0:21076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6cff33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cff3a expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869764.424618:0:21076:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6cff33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cff3a expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869764.424624:0:21076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6cff33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cff3a expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869764.424630:0:21076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6cff33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cff3a expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869764.424654:0:21076:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788869764.424658:0:21076:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788869764.424689:0:21076:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788869764.424694:0:21076:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788869764.424708:0:21076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869764.424714:0:21076:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788869764.424719:0:21076:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8e283d3e19c0) has no exports 00000020:00080000:2.0:1788869764.424744:0:21076:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8e283d3e19c0) has no exports 00010000:00010000:0.0:1788869764.426630:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869764.426647:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6cfbdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cfbe4 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869764.426677:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb800 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:0.0:1788869764.426682:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6cfbdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cfbe4 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869764.426692:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6cfbdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6cfbe4 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869764.426700:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6cfbdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6cfbe4 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869764.426705:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788869764.426709:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788869764.426712:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788869764.426729:0:17086:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e280a5b3000 00010000:00010000:0.0:1788869764.426734:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6cfbdd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6cfbe4 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869764.426741:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6cfbdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6cfbe4 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869764.426755:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869764.426759:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6cff33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cff3a expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869764.426765:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e600 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:0.0:1788869764.426768:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6cff33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cff3a expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869764.426774:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6cff33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6cff3a expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869764.426787:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6cff33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6cff3a expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869764.426792:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788869764.426795:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788869764.426797:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788869764.426813:0:17086:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e280a5b3000 00010000:00010000:0.0:1788869764.426817:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6cff33 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6cff3a expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869764.426823:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840c7e600/0x4c16c38a9b6cff33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6cff3a expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869764.426833:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869764.426835:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869764.426836:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869764.429091:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788869764.429542:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) 71f22428-daa5-41c2-b06f-55c4031bf12e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788869764.429549:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) 71f22428-daa5-41c2-b06f-55c4031bf12e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869764.429552:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788869764.429556:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788869764.429727:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875765325186304:0@lo:400:kworker.0 00000400:00000100:0.0:1788869764.429795:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325186304 offset 0 length 224: 4 00000020:01000000:2.0:1788869764.436780:0:21076:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2840ac40c0 - data ffff8e2810882af8/ffff8e282a332800 00000020:01000000:2.0:1788869764.436968:0:21076:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2701e4c6c0 - data ffff8e2831df1bd0/ffff8e2805ee0c00 00100000:10000000:2.0:1788869764.443308:0:21076:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788869764.452781:0:21076:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfbf2 00000020:00000080:3.0:1788869764.452795:0:21076:0:(genops.c:885:class_export_put()) final put ffff8e282aaf3000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788869764.452823:0:21076:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2817531000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788869764.452827:0:21076:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2817531000 2 00000020:01000004:3.0:1788869764.452830:0:21076:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e2817531000 from lustre-OST0000 00000020:00000080:3.0:1788869764.452861:0:21076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788869764.452873:0:21076:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788869764.452902:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282aaf3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788869764.454204:0:21076:0:(genops.c:885:class_export_put()) final put ffff8e282d8cc800/lustre-OST0000_UUID 00000020:00000080:3.0:1788869764.454212:0:21076:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282d8cc800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788869764.454221:0:21076:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788869764.454293:0:21076:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788869764.454298:0:21076:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788869764.454304:0:21076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788869764.454311:0:21076:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788869764.454317:0:21076:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8e282da7f000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788869764.454334:0:21076:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff8e283b5799c0) has exports, disconnecting them 00000020:00080000:3.0:1788869764.454339:0:21076:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8e282da7f000), last request at 1788869671 00000020:00000080:3.0:1788869764.454344:0:21076:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfc1c 00000020:00080000:3.0:1788869764.454358:0:21076:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e282da7f000): rc 0 00000020:00000080:3.0:1788869764.454372:0:21076:0:(genops.c:885:class_export_put()) final put ffff8e282da7f000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788869764.454445:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282da7f000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788869764.458770:0:21076:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788869764.458778:0:21076:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788869764.458782:0:21076:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788869764.458789:0:21076:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788869764.458880:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e282db38800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788869764.459126:0:21076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869764.459135:0:21076:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788869764.459141:0:21076:0:(genops.c:885:class_export_put()) final put ffff8e282da7e800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788869764.459145:0:21076:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282da7e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788869764.459160:0:21076:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788869764.459229:0:21076:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788869764.459233:0:21076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788869764.459238:0:21076:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788869764.459245:0:21076:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8e2804fbf800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788869764.459251:0:21076:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff8e283b57cd40) has exports, disconnecting them 00000020:00080000:0.0:1788869764.459255:0:21076:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8e2804fbf800), last request at 1788869671 00000020:00000080:0.0:1788869764.459259:0:21076:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfc31 00000020:00080000:0.0:1788869764.459276:0:21076:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2804fbf800): rc 0 00000020:00000080:0.0:1788869764.459280:0:21076:0:(genops.c:885:class_export_put()) final put ffff8e2804fbf800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788869764.459337:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2804fbf800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788869764.462651:0:21076:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788869764.462662:0:21076:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788869764.462667:0:21076:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788869764.462674:0:21076:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788869764.462719:0:475:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2804fbd000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788869764.462970:0:21076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869764.462979:0:21076:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788869764.462996:0:21076:0:(genops.c:885:class_export_put()) final put ffff8e282da7e000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788869764.463000:0:21076:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282da7e000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788869764.463007:0:21076:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788869764.463077:0:21076:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2817531000 1 00000020:00000080:1.0:1788869764.463084:0:21076:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfbcf 00000020:00000080:1.0:1788869764.463095:0:21076:0:(genops.c:885:class_export_put()) final put ffff8e2829c0b000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788869764.463108:0:21076:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788869764.463119:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2829c0b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788869764.463134:0:21076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869764.463141:0:21076:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788869764.463148:0:21076:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff8e28179fb380) has no exports 00000020:00000080:2.0:1788869764.511274:0:21076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869764.511289:0:21076:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788869764.511295:0:21076:0:(genops.c:885:class_export_put()) final put ffff8e2701f1b000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788869764.511299:0:21076:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2701f1b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788869764.511311:0:21076:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788869764.511878:0:21076:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e2817531800 00000020:02000400:2.0:1788869764.511939:0:21076:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788869764.809399:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869765.829875:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869766.865047:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1788869767.433128:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869751/real 1788869751] req@ffff8e270402e680 x1875765325185408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788869767 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869767.488109:0:3648:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8e270402e680 x1875765325185408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788869767 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788869767.488125:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8e282daf5000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788869767.488129:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788869767.525619:0:3648:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1788869767.525805:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 71f22428-daa5-41c2-b06f-55c4031bf12e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788869767.525810:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 71f22428-daa5-41c2-b06f-55c4031bf12e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788869767.525813:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788869767.525816:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788869767.525819:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788869767.525821:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788869767.525826:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e282daf5000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869767.525835:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 623 00000100:00080000:1.0:1788869767.525850:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e282daf5000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869767.525888:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325185408:0@lo:400:kworker.0 00000100:00100000:1.0:1788869767.525899:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27038eb800 x1875765325186432/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869767.525939:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765325186432:0@lo:38:kworker.0 00000400:00000100:3.0:1788869767.525997:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875765325186432 offset 0 length 520: 4 00010000:00010000:3.0:1788869767.881396:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788869768.814710:0:21279:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788869768.822746:0:21279:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788869768.822844:0:21279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d7400/0x4c16c38a9b6cfd65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfd6c expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869768.822873:0:21279:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d7400/0x4c16c38a9b6cfd65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfd6c expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869768.822899:0:21279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d7400/0x4c16c38a9b6cfd65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cfd6c expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869768.822906:0:21279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e28029d7400/0x4c16c38a9b6cfd65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cfd6c expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869768.822933:0:21279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788869768.822939:0:21279:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788869768.822967:0:21279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788869768.822978:0:21279:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e270402ce00 x1875765325185280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788869771 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869768.823001:0:21279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788869768.823008:0:21279:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788869768.823015:0:21279:0:(import.c:65:import_set_state_nolock()) ffff8e2704807800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788869768.823021:0:21279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788869768.823025:0:21279:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e270402ce00 x1875765325185280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788869771 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869768.823032:0:21279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788869768.823035:0:21279:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:2.0:1788869768.823084:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765325185280:0@lo:38:kworker.0 00000100:00080000:2.0:1788869768.823948:0:21279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788869768.823957:0:21279:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e280138ea00 x1875765325185664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869770 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869768.823975:0:21279:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e280138fb80 x1875765325185920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869772 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869768.823995:0:21279:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e270402e300 x1875765325186176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869775 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869768.824019:0:21279:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e280138d500 x1875765325186304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869780 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869768.824031:0:21279:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e27038eb800 x1875765325186432/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788869777 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869768.824039:0:21279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1788869768.824065:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325185664:0@lo:400:kworker.0 00000100:00080000:2.0:1788869768.824095:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282daf5000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869768.824099:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1788869768.824102:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765325186432:0@lo:38:kworker.0 00000100:00080000:2.0:1788869768.824133:0:21279:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788869768.824137:0:21279:0:(import.c:65:import_set_state_nolock()) ffff8e282daf5000 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788869768.824142:0:21279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788869768.824146:0:21279:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e280138fb80 x1875765325185920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869772 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869768.824154:0:21279:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e270402e300 x1875765325186176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869775 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869768.824160:0:21279:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e280138d500 x1875765325186304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869780 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869768.824165:0:21279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788869768.824168:0:21279:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:2.0:1788869768.824196:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325186176:0@lo:400:kworker.0 00010000:00010000:0.0:1788869768.824837:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869768.824847:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e28029d7400/0x4c16c38a9b6cfd65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cfd6c expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869768.824867:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d7400 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:0.0:1788869768.824872:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e28029d7400/0x4c16c38a9b6cfd65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cfd6c expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869768.824883:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28029d7400/0x4c16c38a9b6cfd65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6cfd6c expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869768.824890:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28029d7400/0x4c16c38a9b6cfd65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6cfd6c expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869768.824895:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788869768.824898:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788869768.824901:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788869768.824917:0:17086:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e280a5b3000 00010000:00010000:0.0:1788869768.824920:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e28029d7400/0x4c16c38a9b6cfd65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6cfd6c expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869768.824937:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28029d7400/0x4c16c38a9b6cfd65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6cfd6c expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869768.824951:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869768.824953:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869768.824954:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869768.824975:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875765325186304:0@lo:400:kworker.0 00000100:00100000:0.0:1788869768.825252:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325185920:0@lo:400:kworker.0 00010000:00010000:2.0:1788869768.827732:0:21279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fc00/0x4c16c38a9b6cfd3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cfd42 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869768.827750:0:21279:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fc00/0x4c16c38a9b6cfd3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cfd42 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869768.827772:0:21279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fc00/0x4c16c38a9b6cfd3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cfd42 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869768.827778:0:21279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fc00/0x4c16c38a9b6cfd3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cfd42 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869768.827800:0:21279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869768.827808:0:21279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6cff25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6cff2c expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869768.827815:0:21279:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6cff25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6cff2c expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869768.827821:0:21279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6cff25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cff2c expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869768.827826:0:21279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6cff25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4c16c38a9b6cff2c expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869768.827838:0:21279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788869768.827842:0:21279:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788869768.827885:0:21279:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788869768.827890:0:21279:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788869768.827895:0:21279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869768.827900:0:21279:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788869768.827904:0:21279:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff8e27029cb380) has no exports 00000020:00080000:2.0:1788869768.827928:0:21279:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff8e27029cb380) has no exports 00010000:00010000:3.0:1788869768.829666:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869768.829681:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fc00/0x4c16c38a9b6cfd3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cfd42 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869768.829693:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7fc00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869768.829698:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fc00/0x4c16c38a9b6cfd3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cfd42 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869768.829709:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fc00/0x4c16c38a9b6cfd3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6cfd42 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869768.829716:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fc00/0x4c16c38a9b6cfd3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6cfd42 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869768.829722:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788869768.829725:0:17087:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788869768.829728:0:17087:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788869768.829746:0:17087:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e280a5b3000 00010000:00010000:3.0:1788869768.829764:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fc00/0x4c16c38a9b6cfd3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6cfd42 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869768.829771:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840c7fc00/0x4c16c38a9b6cfd3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6cfd42 expref: -99 pid: 19420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869768.829786:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869768.829790:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6cff25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cff2c expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869768.829795:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842042600 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869768.829797:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6cff25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4c16c38a9b6cff2c expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869768.829804:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6cff25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6cff2c expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869768.829810:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6cff25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6cff2c expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869768.829816:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788869768.829818:0:17087:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788869768.829820:0:17087:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788869768.829825:0:17087:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e280a5b3000 00010000:00010000:3.0:1788869768.829828:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6cff25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6cff2c expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869768.829834:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6cff25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6cff2c expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869768.829850:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869768.829870:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869768.829872:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869768.831976:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788869768.835205:0:21279:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2840ac4a20 - data ffff8e2831c00ca8/ffff8e282a331c00 00000020:01000000:2.0:1788869768.837027:0:21279:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e2701e7ae40 - data ffff8e2810a4a000/ffff8e2825ceac00 00100000:10000000:2.0:1788869768.856270:0:21279:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788869768.880078:0:21279:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfd50 00000020:00000080:0.0:1788869768.880091:0:21279:0:(genops.c:885:class_export_put()) final put ffff8e282aaf0800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788869768.880145:0:21279:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2840b8a000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788869768.880150:0:21279:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2840b8a000 2 00000020:01000004:0.0:1788869768.880153:0:21279:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e2840b8a000 from lustre-OST0001 00000020:00000080:0.0:1788869768.880184:0:21279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869768.880196:0:21279:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788869768.880200:0:21279:0:(genops.c:885:class_export_put()) final put ffff8e282aaf7800/lustre-OST0001_UUID 00000020:00000080:0.0:1788869768.880204:0:21279:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282aaf7800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788869768.880212:0:21279:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788869768.880363:0:21279:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 71f22428-daa5-41c2-b06f-55c4031bf12e->MGS 00010000:00010000:0.0:1788869768.880384:0:21279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28014a8600/0x4c16c38a9b6cfa9b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6cfaa2 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869768.880397:0:21279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8600/0x4c16c38a9b6cfa9b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6cfaa2 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869768.880405:0:21279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788869768.880407:0:21279:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788869768.880411:0:21279:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788869768.880437:0:21279:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e280a5b3000 00010000:00010000:0.0:1788869768.880532:0:21279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28014a8600/0x4c16c38a9b6cfa9b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6cfaa2 expref: -99 pid: 17830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869768.880550:0:21279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6cf98a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4c16c38a9b6cf991 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869768.880558:0:21279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6cf98a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4c16c38a9b6cf991 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869768.880563:0:21279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788869768.880566:0:21279:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788869768.880567:0:21279:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788869768.880578:0:21279:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e280a5b3000 00010000:00010000:0.0:1788869768.880581:0:21279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e28014a8e00/0x4c16c38a9b6cf98a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4c16c38a9b6cf991 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788869768.880619:0:21279:0:(import.c:65:import_set_state_nolock()) ffff8e280a5b3000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788869768.880625:0:21279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788869768.880628:0:21279:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788869768.880630:0:21279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788869768.880635:0:21279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788869768.880648:0:21279:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e270402d880 x1875765325186048/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788869774 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788869768.880667:0:21279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788869768.880670:0:21279:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000020:00000080:2.0:1788869768.882571:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282aaf0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1788869768.882650:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:71f22428-daa5-41c2-b06f-55c4031bf12e:3647:1875765325186048:0@lo:250:kworker.0 10000000:01000000:0.0:1788869768.882847:0:21279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788869768.882862:0:21279:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cf975 00000020:00000080:0.0:1788869768.882872:0:21279:0:(genops.c:885:class_export_put()) final put ffff8e2703aea800/71f22428-daa5-41c2-b06f-55c4031bf12e 00000020:01000000:0.0:1788869768.882896:0:21279:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.154@tcp (flags='') 00000020:00000080:0.0:1788869768.882908:0:21279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788869768.882918:0:21279:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.154@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788869768.882939:0:21279:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8e27025e99c0) has no exports 00000020:00000080:2.0:1788869768.883002:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2703aea800/71f22428-daa5-41c2-b06f-55c4031bf12e for MGC192.168.204.154@tcp 10000000:01000000:1.0:1788869768.883217:0:17095:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788869768.883364:0:21279:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.204.154@tcp: client import never connected 00000100:00080000:0.0:1788869768.883369:0:21279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788869768.883372:0:21279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788869768.883375:0:21279:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788869768.883377:0:21279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788869768.883427:0:21279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788869768.883435:0:21279:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.154@tcp (uuid 71f22428-daa5-41c2-b06f-55c4031bf12e) 00000020:01000000:0.0:1788869768.883454:0:21279:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788869768.883458:0:21279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788869768.883462:0:21279:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788869768.883467:0:21279:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8e2704802000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788869768.883473:0:21279:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff8e28179fcd40) has exports, disconnecting them 00000020:00080000:0.0:1788869768.883478:0:21279:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8e2704802000), last request at 1788869689 00000020:00000080:0.0:1788869768.883482:0:21279:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfd7a 00000020:00080000:0.0:1788869768.883494:0:21279:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e2704802000): rc 0 00000020:00000080:0.0:1788869768.883497:0:21279:0:(genops.c:885:class_export_put()) final put ffff8e2704802000/lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788869768.884261:0:21279:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788869768.884267:0:21279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788869768.884270:0:21279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788869768.884285:0:21279:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788869768.884412:0:21279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788869768.884418:0:21279:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788869768.884422:0:21279:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788869768.884426:0:21279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788869768.884430:0:21279:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788869768.884436:0:21279:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8e282daf2000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788869768.884442:0:21279:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff8e27025e8000) has exports, disconnecting them 00000020:00080000:1.0:1788869768.884446:0:21279:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8e282daf2000), last request at 1788869689 00000020:00000080:1.0:1788869768.884450:0:21279:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfd88 00000020:00080000:1.0:1788869768.884463:0:21279:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e282daf2000): rc 0 00000020:00000080:1.0:1788869768.884467:0:21279:0:(genops.c:885:class_export_put()) final put ffff8e282daf2000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1788869768.885175:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e280a5b3000 for MGC192.168.204.154@tcp 00000020:00000080:2.0:1788869768.885185:0:8:0:(genops.c:885:class_export_put()) final put ffff8e280a5b2800/71f22428-daa5-41c2-b06f-55c4031bf12e 00000020:00000080:2.0:1788869768.885188:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e280a5b2800/71f22428-daa5-41c2-b06f-55c4031bf12e for MGC192.168.204.154@tcp 00000020:01000000:2.0:1788869768.885195:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.154@tcp (71f22428-daa5-41c2-b06f-55c4031bf12e) 00000020:00000080:2.0:1788869768.885515:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2704802000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788869768.885522:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e2704807800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788869768.885526:0:8:0:(genops.c:885:class_export_put()) final put ffff8e2827a91000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788869768.885528:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2827a91000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788869768.885530:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788869768.885562:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e282daf2000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788869768.885627:0:21279:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788869768.885631:0:21279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788869768.885634:0:21279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788869768.885638:0:21279:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788869768.885661:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e282daf5000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788869768.887636:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788869768.889878:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:2.0:1788869768.890153:0:17081:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8e2703b0a200:17081] 0 exiting: rc = 1 00000100:00100000:2.0:1788869768.893351:0:17082:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8e2840ecd200:17082] 1 exiting: rc = 0 00000100:00100000:2.0:1788869768.893491:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.893849:0:17083:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8e2840ecda00:17083] 0 exiting: rc = 1 00000100:00100000:2.0:1788869768.895726:0:17085:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8e2703917800:17085] 2 exiting: rc = 0 00000100:00100000:1.0:1788869768.901818:0:20875:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8e282a731800:20875] 3 exiting: rc = 0 00000100:00100000:2.0:1788869768.905748:0:17084:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8e2840ecd800:17084] 1 exiting: rc = 0 00000100:00100000:2.0:1788869768.905907:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.905914:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.905921:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.905928:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.905933:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.905939:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.905945:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.905950:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.905955:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.905961:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.905966:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.905971:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.905976:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.905982:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.905987:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.905994:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.905999:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906006:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906011:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906017:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906023:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906028:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906033:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906038:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906043:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906049:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906054:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906058:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906063:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906071:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906076:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906081:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906085:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906092:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906097:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906113:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906119:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906124:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906130:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906134:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906139:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906145:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906150:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906154:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906161:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906165:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906170:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906176:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906181:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906188:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906193:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906199:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906204:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906209:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906215:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906221:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906225:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906231:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906236:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906241:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906247:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906253:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906258:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869768.906263:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788869768.907032:0:21279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869768.907042:0:21279:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788869768.907048:0:21279:0:(genops.c:885:class_export_put()) final put ffff8e2840b8b000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788869768.907053:0:21279:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840b8b000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788869768.907058:0:21279:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788869768.907120:0:21279:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2840b8a000 1 00000020:00000080:2.0:1788869768.907126:0:21279:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4c16c38a9b6cfd34 00000020:00000080:2.0:1788869768.907133:0:21279:0:(genops.c:885:class_export_put()) final put ffff8e2840b8a800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788869768.907145:0:21279:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788869768.907158:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840b8a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788869768.907170:0:21279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869768.907175:0:21279:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788869768.907179:0:21279:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff8e27029c99c0) has no exports 00000020:00000080:2.0:1788869769.167777:0:21279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869769.167795:0:21279:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788869769.167803:0:21279:0:(genops.c:885:class_export_put()) final put ffff8e2840b89000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788869769.167808:0:21279:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2840b89000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788869769.167819:0:21279:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788869769.168210:0:21279:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e2840b8f800 00000020:01000000:2.0:1788869769.168237:0:21279:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788869769.168241:0:21279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788869769.168246:0:21279:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788869769.168250:0:21279:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff8e283b57b380) has no exports 00000020:00000080:2.0:1788869769.168291:0:21279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788869769.168296:0:21279:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788869769.168300:0:21279:0:(genops.c:885:class_export_put()) final put ffff8e2829c08800/OSS_uuid 00000020:00000080:2.0:1788869769.168302:0:21279:0:(genops.c:844:class_export_destroy()) destroying export ffff8e2829c08800/OSS_uuid for OSS 00000020:01000000:2.0:1788869769.168305:0:21279:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788869769.168403:0:18991:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8e2702b5d800:18991] 3 exiting: rc = 0 00000100:00100000:2.0:1788869769.168498:0:18606:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8e2809f45600:18606] 2 exiting: rc = 0 00000100:00100000:2.0:1788869769.168553:0:18605:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8e280587be00:18605] 1 exiting: rc = 0 00000100:00080000:3.0:1788869769.169869:0:17094:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788869769.172376:0:18604:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8e283d3a4c00:18604] 0 exiting: rc = 1 00000100:00100000:2.0:1788869769.172698:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172708:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172713:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172719:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172725:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172730:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172754:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172759:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172764:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172769:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172774:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172779:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172783:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172788:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172794:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172799:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172804:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172810:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172815:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172820:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172825:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172831:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172836:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172841:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172846:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172851:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172856:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172860:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172865:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172869:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172874:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172878:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172883:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172888:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172892:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172897:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172901:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172906:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172910:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172915:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172919:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172933:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172938:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172943:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172948:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172953:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172958:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172964:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172970:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172975:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172980:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172984:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172989:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172993:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.172999:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.173003:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.173008:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.173013:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.173017:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.173021:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.173026:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.173032:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.173037:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.173041:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.184519:0:18609:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8e283d3a5200:18609] 1 exiting: rc = 0 00000100:00100000:0.0:1788869769.184653:0:18608:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8e2805849e00:18608] 0 exiting: rc = 1 00000100:00100000:3.0:1788869769.184779:0:20240:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8e2704252c00:20240] 2 exiting: rc = 0 00000100:00100000:2.0:1788869769.184855:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184862:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184868:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184874:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184880:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184885:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184890:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184895:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184900:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184904:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184909:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184914:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184937:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184942:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184948:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184953:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184958:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184974:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184980:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184985:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184990:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.184995:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185000:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185006:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185011:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185204:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185212:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185218:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185223:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185227:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185232:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185237:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185242:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185247:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185252:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185257:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185263:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185281:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185287:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185293:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185298:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185304:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185310:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185315:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185321:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185327:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185332:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185345:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185351:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185438:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185444:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185450:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185462:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185470:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185476:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185486:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185494:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185499:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185504:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185509:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185514:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185519:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185524:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788869769.185529:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.186853:0:18611:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8e283cd9e000:18611] 1 exiting: rc = 0 00000100:00100000:0.0:1788869769.187063:0:18610:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8e283cd9ee00:18610] 0 exiting: rc = 1 00000100:00100000:1.0:1788869769.187432:0:18612:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8e283cd9fa00:18612] 2 exiting: rc = 0 00000100:00100000:3.0:1788869769.189372:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.189383:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.189389:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.189402:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.189410:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.189416:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.189421:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.189426:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.189432:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.189437:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190727:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190751:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190775:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190783:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190790:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190795:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190802:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190807:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190812:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190818:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190823:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190828:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190833:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190838:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190843:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190848:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190854:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190859:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190865:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190870:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190891:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190896:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190901:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190907:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190913:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190919:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190940:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190948:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190954:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190959:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190966:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190971:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190977:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190983:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190989:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.190995:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.191001:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.191006:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.191012:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.191018:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.191024:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.191030:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.191035:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.191040:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.191055:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.191070:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.191077:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.191083:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.191088:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.191094:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.191099:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.191104:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.191110:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788869769.191116:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788869769.211676:0:18614:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8e28063b4000:18614] 1 exiting: rc = 0 00000100:00100000:2.0:1788869769.211678:0:18613:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8e282a733a00:18613] 0 exiting: rc = 1 00000100:00100000:0.0:1788869769.218056:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218069:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218075:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218081:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218086:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218091:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218097:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218102:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218108:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218114:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218138:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218143:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218149:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218153:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218158:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218164:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218169:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218175:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218181:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218188:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218193:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218199:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218204:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218209:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218215:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218220:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218225:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218231:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218236:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218242:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218247:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218252:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218257:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218263:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218282:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218288:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218293:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218298:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218303:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218307:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218369:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218375:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218380:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218385:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218390:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218403:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218409:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218414:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218419:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218425:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218430:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218436:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218876:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218885:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218890:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218895:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218900:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218905:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218910:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218914:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218919:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218925:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218930:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.218936:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.221790:0:18615:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8e2701f03c00:18615] 0 exiting: rc = 1 00000100:00100000:1.0:1788869769.222011:0:18616:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8e2701f03000:18616] 1 exiting: rc = 0 00000100:00100000:0.0:1788869769.223642:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223653:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223674:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223681:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223688:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223694:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223701:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223708:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223714:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223719:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223725:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223745:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223752:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223759:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223764:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223787:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223793:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223801:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223809:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223815:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223821:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223828:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223834:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223854:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223861:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223867:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223873:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223879:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223885:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223891:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223898:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223904:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223909:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223915:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223921:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223942:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223950:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223956:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223962:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223968:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223974:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223980:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223986:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.223994:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.224001:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.224009:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.224016:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.224036:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.224045:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.224051:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.224064:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.224070:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.224076:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.224083:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.224088:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.224094:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.224101:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.224107:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.224113:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.224135:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.224143:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.224150:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.224156:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788869769.224169:0:21279:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788869769.249432:0:21279:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788869792.755199:0:22043:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788869804.758836:0:22643:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788869804.758845:0:22643:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788869804.758847:0:22643:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788869804.760201:0:22643:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e283b011000 00000020:01000004:1.0:1788869804.760221:0:22643:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788869804.760229:0:22643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788869804.760247:0:22643:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8e28179f99c0) 00000020:00000080:1.0:1788869804.760264:0:22643:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788869804.849649:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788869804.860431:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788869804.865179:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788869804.867271:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788869804.867639:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788869804.868713:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788869804.868964:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788869804.869293:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788869804.871111:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788869804.871484:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788869804.871680:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788869804.872805:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788869804.873446:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788869804.873873:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788869804.876357:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788869804.888208:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788869804.889449:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788869804.890861:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788869804.894106:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788869804.895443:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788869804.898467:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788869804.905508:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788869804.906325:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788869804.906715:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788869804.907207:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788869804.907447:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788869804.907876:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788869804.908212:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788869804.908671:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788869804.909024:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788869804.909434:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788869804.910061:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788869804.911651:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788869804.912218:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788869804.912578:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788869804.913090:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788869804.913605:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788869804.914157:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788869804.914896:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788869804.915202:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788869804.915621:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788869804.916066:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788869804.916697:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788869804.917926:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788869804.918189:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788869804.920889:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788869804.921282:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788869804.929829:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788869804.938406:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788869804.938768:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788869804.939431:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788869804.945892:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788869804.947694:0:22643:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:3.0:1788869804.950149:0:22643:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788869804.953237:0:22643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788869804.953251:0:22643:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788869804.953269:0:22643:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6d027b 00000020:01000004:3.0:1788869804.953279:0:22643:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788869804.953284:0:22643:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788869804.953292:0:22643:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e283b011000 from MGS 00000020:01000004:3.0:1788869804.953296:0:22643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788869804.953314:0:22643:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8e27025eb380) 00000020:00000080:3.0:1788869804.953330:0:22643:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788869804.954910:0:22643:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e283b011000 from MGS, refs=2 00080000:01000000:3.0:1788869804.954927:0:22643:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788869804.954937:0:22643:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6d0289 00000100:00100000:3.0:1788869804.955837:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788869804.956003:0:22643:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788869804.956009:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788869804.958030:0:22643:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788869804.958050:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788869804.977882:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869804.978319:0:22643:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788869804.978327:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788869804.979384:0:22643:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788869804.979394:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788869804.980071:0:22643:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788869804.980079:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788869804.980737:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869804.980740:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869804.980742:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869804.981089:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869804.981092:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869804.981094:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869804.981635:0:22643:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788869804.984193:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788869804.991822:0:22643:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788869804.993772:0:22655:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788869804.993829:0:22643:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788869804.993881:0:22643:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788869804.996349:0:22643:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788869804.996798:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788869804.998420:0:22643:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788869804.998430:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788869805.000054:0:22643:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788869805.000068:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788869805.005075:0:22643:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788869805.005092:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788869805.008106:0:22643:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788869805.008130:0:22643:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.154@tcp' 00000020:01000004:0.0:1788869805.008132:0:22643:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788869805.008166:0:22643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.154@tcp (typ=mgc) 00000020:00000080:0.0:1788869805.008178:0:22643:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.154@tcp (ffff8e27029cb380) 00000020:00000080:0.0:1788869805.008192:0:22643:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788869805.008280:0:22643:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2703492000@MGC192.168.204.154@tcp: add connection 192.168.204.154@tcp at head 00010000:00010000:0.0:1788869805.008459:0:22643:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.154@tcp-0 is initialized 00000040:01000000:0.0:1788869805.008465:0:22643:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788869805.008916:0:22660:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788869805.015568:0:22661:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788869805.017495:0:22643:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.154@tcp (uuid c082ff99-6a3f-4428-a6f2-973bbd93c10a) 00000020:00000080:1.0:1788869805.017565:0:22643:0:(genops.c:1384:class_connect()) connect: client c082ff99-6a3f-4428-a6f2-973bbd93c10a, cookie 0x4c16c38a9b6d0297 00000100:00080000:1.0:1788869805.017581:0:22643:0:(import.c:545:import_select_connection()) MGC192.168.204.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788869805.017614:0:22643:0:(import.c:666:import_select_connection()) MGC192.168.204.154@tcp: import ffff8e2703492000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869805.017662:0:22643:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27038e9500 x1875765325186560/t0(0) o250->MGC192.168.204.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788869805.017699:0:22643:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c082ff99-6a3f-4428-a6f2-973bbd93c10a->MGS 00000020:01000004:1.0:1788869805.017752:0:22643:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788869805.017758:0:22643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788869805.017775:0:22643:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8e28179fcd40) 00000020:00000080:1.0:1788869805.017791:0:22643:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788869805.018113:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3647:1875765325186560:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788869805.018181:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869805.018218:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325186560 00000100:00100000:0.0:1788869805.018228:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325186560 00000100:00100000:0.0:1788869805.018264:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869805.018274:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805cbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3647:x1875765325186560:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788869805.018298:0:22657:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from c082ff99-6a3f-4428-a6f2-973bbd93c10a@0@lo t0 exp 0000000000000000 cur 738 last 0 00000020:00000080:0.0:1788869805.018326:0:22657:0:(genops.c:1384:class_connect()) connect: client c082ff99-6a3f-4428-a6f2-973bbd93c10a, cookie 0x4c16c38a9b6d02a5 00000100:00080000:0.0:1788869805.018444:0:22657:0:(import.c:65:import_set_state_nolock()) ffff8e2703492800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869805.020175:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805cbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+5:3647:x1875765325186560:12345-0@lo:250:mount.lustre.0 Request processed in 1894us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869805.020189:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869805.022217:0:3647:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788869805.022238:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.154@tcp: connect to target with instance 0 00000100:00080000:2.0:1788869805.022249:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788869805.022273:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788869805.022280:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2703492000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788869805.022285:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788869805.022308:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788869805.022320:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3647:1875765325186560:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788869805.043876:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869805.044210:0:22643:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788869805.044217:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788869805.055179:0:22643:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788869805.055933:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788869805.058084:0:22643:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788869805.058101:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788869805.061699:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869805.061899:0:22643:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788869805.061905:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788869805.064165:0:22643:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788869805.064180:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788869805.155120:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869805.155391:0:22643:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788869805.155398:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788869805.159727:0:22643:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788869805.159745:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788869805.176097:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869805.176329:0:22643:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788869805.176336:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788869805.183780:0:22643:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788869805.183803:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788869805.184812:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869805.185001:0:22643:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788869805.185005:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788869805.186889:0:22643:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788869805.186901:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788869805.187461:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788869805.188125:0:22643:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788869805.188130:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788869805.192027:0:22643:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788869805.192043:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788869805.238089:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788869805.239077:0:22643:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788869805.239086:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788869805.250633:0:22643:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788869805.250655:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788869805.253495:0:22643:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788869805.253524:0:22643:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788869805.255544:0:22643:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788869805.255577:0:22643:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788869805.255610:0:22643:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788869805.255754:0:22643:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788869805.255802:0:22643:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788869805.255807:0:22643:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788869805.255809:0:22643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788869805.255812:0:22643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869805.255813:0:22643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869805.255815:0:22643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869805.255816:0:22643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869805.255817:0:22643:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869805.255819:0:22643:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788869805.255821:0:22643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869805.255823:0:22643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788869805.255826:0:22643:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788869805.255833:0:22643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788869805.255834:0:22643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788869805.255835:0:22643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869805.255836:0:22643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869805.255837:0:22643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869805.255838:0:22643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869805.255839:0:22643:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869805.255840:0:22643:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788869805.255841:0:22643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869805.255842:0:22643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788869805.255875:0:22643:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788869805.255899:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325186688:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788869805.256007:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869805.256067:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2829aba600 going to sleep for 11 seconds 00000100:00100000:1.0:1788869805.256873:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325186688 00000100:00100000:1.0:1788869805.256885:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325186688 00000100:00100000:1.0:1788869805.256939:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869805.256949:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805cbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+5:22643:x1875765325186688:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788869805.257010:0:22659:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788869805.257013:0:22659:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788869805.257016:0:22659:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788869805.259793:0:22680:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788869805.263739:0:22659:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1788869805.266481:0:22681:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788869805.266492:0:22681:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788869805.266495:0:22681:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788869805.266498:0:22681:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788869805.266827:0:22681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788869805.267038:0:22659:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788869805.267050:0:22659:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788869805.268710:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805cbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+5:22643:x1875765325186688:12345-0@lo:253:mount.lustre.0 Request processed in 11751us (12693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869805.268727:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869805.268903:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325186688:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788869805.268922:0:22643:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788869805.268926:0:22643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788869805.268928:0:22643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788869805.268929:0:22643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869805.268930:0:22643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869805.268932:0:22643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869805.268933:0:22643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869805.268935:0:22643:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788869805.268936:0:22643:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788869805.268938:0:22643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869805.268940:0:22643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788869805.268962:0:22643:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e283b011000 from lustre-MDT0000 10000000:01000000:3.0:1788869805.268994:0:22643:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788869805.268998:0:22643:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788869805.269003:0:22643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e27029cb380 10000000:01000000:3.0:1788869805.269017:0:22643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788869805.269027:0:22643:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e27029cb380 from 1 10000000:01000000:3.0:1788869805.269031:0:22643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788869805.269072:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9800/0x4c16c38a9b6d02ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.269083:0:22643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9800/0x4c16c38a9b6d02ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.269093:0:22643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9800/0x4c16c38a9b6d02ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869805.269115:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325186816:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788869805.269156:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869805.269199:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2829abab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869805.269427:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325186816 00000100:00100000:1.0:1788869805.269433:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325186816 00000100:00100000:1.0:1788869805.269615:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869805.269633:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805cbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+5:22643:x1875765325186816:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869805.269646:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869805.269660:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6d02b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d02ac expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869805.269687:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6d02b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d02ac expref: 6 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869805.269699:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edb600/0x4c16c38a9b6d02b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d02ac expref: 6 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869805.269707:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb600, rc 0) 00000100:00100000:1.0:1788869805.269748:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805cbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+6:22643:x1875765325186816:12345-0@lo:101:mount.lustre.0 Request processed in 116us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869805.269754:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869805.269827:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325186816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869805.269842:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9800/0x4c16c38a9b6d02ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d02b3 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.269852:0:22643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9800/0x4c16c38a9b6d02ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d02b3 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869805.269906:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325186944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869805.269930:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869805.273051:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2829abab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869805.273165:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325186944 00000100:00100000:2.0:1788869805.273180:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325186944 00000100:00100000:2.0:1788869805.273255:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869805.273266:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+6:22643:x1875765325186944:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869805.273414:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+6:22643:x1875765325186944:12345-0@lo:501:mount.lustre.0 Request processed in 149us (3481us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788869805.273421:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869805.277888:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325186944:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788869805.277941:0:22643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788869805.277968:0:22643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9800/0x4c16c38a9b6d02ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d02b3 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.277999:0:22643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9800/0x4c16c38a9b6d02ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d02b3 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869805.278009:0:22643:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e283b011000 10000000:01000000:3.0:1788869805.278015:0:22643:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788869805.278021:0:22643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e283b011000 10000000:01000000:3.0:1788869805.278024:0:22643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788869805.278027:0:22643:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e283b011000 from 1 10000000:01000000:3.0:1788869805.278029:0:22643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788869805.278068:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9000/0x4c16c38a9b6d02ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.278078:0:22643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9000/0x4c16c38a9b6d02ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.278099:0:22643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9000/0x4c16c38a9b6d02ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869805.278123:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325187072:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788869805.278197:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869805.278400:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2829abab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869805.278472:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325187072 00000100:00100000:0.0:1788869805.278480:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325187072 00000100:00100000:0.0:1788869805.278541:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788869805.278555:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+6:22643:x1875765325187072:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869805.278569:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869805.278584:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbb5e00/0x4c16c38a9b6d02c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d02ba expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869805.278627:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb5e00/0x4c16c38a9b6d02c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d02ba expref: 7 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869805.278639:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbb5e00/0x4c16c38a9b6d02c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d02ba expref: 7 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869805.278648:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5e00, rc 0) 00000100:00100000:0.0:1788869805.278685:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+7:22643:x1875765325187072:12345-0@lo:101:mount.lustre.0 Request processed in 131us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869805.278691:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788869805.279085:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325187072:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869805.279113:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9000/0x4c16c38a9b6d02ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d02c1 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.279122:0:22643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9000/0x4c16c38a9b6d02ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d02c1 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869805.279148:0:22643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788869805.279153:0:22643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9000/0x4c16c38a9b6d02ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d02c1 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.279160:0:22643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9000/0x4c16c38a9b6d02ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d02c1 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869805.279167:0:22643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788869805.279171:0:22643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788869805.279177:0:22643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e283b011000 10000000:01000000:3.0:1788869805.279180:0:22643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788869805.279183:0:22643:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788869805.279185:0:22643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788869805.279202:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8e00/0x4c16c38a9b6d02c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.279208:0:22643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8e00/0x4c16c38a9b6d02c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.279215:0:22643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8e00/0x4c16c38a9b6d02c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869805.279228:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325187200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788869805.279413:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869805.279445:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2829abab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869805.279569:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325187200 00000100:00100000:0.0:1788869805.279574:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325187200 00000100:00100000:0.0:1788869805.279623:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869805.279629:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+7:22643:x1875765325187200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869805.279639:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869805.279647:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6d02cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d02c8 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869805.279661:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6d02cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d02c8 expref: 8 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869805.279669:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbb5800/0x4c16c38a9b6d02cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d02c8 expref: 8 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869805.279675:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5800, rc 0) 00000100:00100000:0.0:1788869805.279706:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+8:22643:x1875765325187200:12345-0@lo:101:mount.lustre.0 Request processed in 77us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869805.279712:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788869805.279800:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325187200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869805.279810:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8e00/0x4c16c38a9b6d02c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d02cf expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.279827:0:22643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8e00/0x4c16c38a9b6d02c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d02cf expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869805.279882:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325187328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869805.279906:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869805.279921:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2829abab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869805.280025:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325187328 00000100:00100000:0.0:1788869805.280030:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325187328 00000100:00100000:0.0:1788869805.280064:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869805.280069:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+8:22643:x1875765325187328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869805.280640:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+9:22643:x1875765325187328:12345-0@lo:501:mount.lustre.0 Request processed in 568us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869805.280647:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869805.280797:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325187328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869805.280832:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325187456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869805.280871:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869805.280896:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2811aa9300 going to sleep for 11 seconds 00000100:00100000:0.0:1788869805.280943:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325187456 00000100:00100000:0.0:1788869805.280947:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325187456 00000100:00100000:0.0:1788869805.281010:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788869805.281017:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+9:22643:x1875765325187456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869805.287522:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+9:22643:x1875765325187456:12345-0@lo:503:mount.lustre.0 Request processed in 6484us (6629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869805.287539:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869805.287716:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325187456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869805.295554:0:22682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22682:1875765325187584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869805.295683:0:22682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869805.295729:0:22682:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2829aba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869805.295854:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325187584 00000100:00100000:2.0:1788869805.295872:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325187584 00000100:00100000:2.0:1788869805.295917:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869805.295928:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+9:22682:x1875765325187584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869805.299484:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+9:22682:x1875765325187584:12345-0@lo:502:llog_process_th.0 Request processed in 3547us (3792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869805.299506:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869805.299708:0:22682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22682:1875765325187584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788869805.299754:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869805.299768:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869805.299771:0:22682:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788869805.299776:0:22682:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788869805.299779:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788869805.299801:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8e283b57b380) 00000020:00000080:2.0:1788869805.299825:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788869805.299830:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788869805.299916:0:22682:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788869805.299922:0:22682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6d02dd 00000020:00000080:2.0:1788869805.300170:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788869805.300175:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869805.300178:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869805.300180:0:22682:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788869805.300183:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869805.300186:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869805.300188:0:22682:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788869805.300191:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788869805.300198:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8e283b57cd40) 00000020:00000080:2.0:1788869805.300207:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788869805.300211:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788869805.300213:0:22682:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788869805.300216:0:22682:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788869805.300222:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788869805.300263:0:22682:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e283b011000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788869805.300275:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8e283b5799c0) 00000020:00000080:2.0:1788869805.300282:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788869805.300362:0:22682:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788869805.300368:0:22682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6d02f2 00000020:00000080:2.0:1788869805.300459:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788869805.300478:0:22682:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788869805.300483:0:22682:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4c16c38a9b6d02f9 00080000:01000000:2.0:1788869805.300488:0:22682:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788869805.300492:0:22682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6d0300 00010000:00010000:1.0:1788869805.429560:0:22682:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788869805.430160:0:22682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:1.0:1788869805.430666:0:22682:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788869805.432376:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8e28179fb380) 00000020:00000080:1.0:1788869805.432399:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788869805.432498:0:22682:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788869805.432514:0:22682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6d030e 00000020:00000080:2.0:1788869805.435077:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788869805.447474:0:22682:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4c16c38a9b6d0315 00000020:00000080:3.0:1788869805.451372:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788869805.451394:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869805.451406:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869805.451408:0:22682:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788869805.451415:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788869805.451419:0:22682:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788869805.451421:0:22682:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788869805.451422:0:22682:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788869805.451424:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788869805.451427:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869805.451428:0:22682:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788869805.451431:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869805.451436:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869805.451438:0:22682:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788869805.451443:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788869805.451516:0:22682:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788869805.451534:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869805.451545:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869805.451547:0:22682:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788869805.451551:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869805.451554:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869805.451555:0:22682:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788869805.451558:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788869805.451565:0:22682:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:00000080:3.0:1788869805.451614:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788869805.451632:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8e27025e8000) 00000020:00000080:3.0:1788869805.451650:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788869805.451656:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788869805.451719:0:22682:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788869805.451725:0:22682:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788869805.451731:0:22682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6d0323 00010000:00080000:3.0:1788869805.451764:0:22682:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e280a5b6800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:3.0:1788869805.454707:0:22682:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788869805.458705:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788869805.458722:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788869805.458765:0:22682:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788869805.458788:0:22682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6d032a 00000100:00080000:1.0:1788869805.458800:0:22682:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788869805.458812:0:22682:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e280a5b6800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869805.458858:0:22682:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27038e9500 x1875765325187712/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788869805.458899:0:22682:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788869805.458980:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869805.458985:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869805.458987:0:22682:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788869805.458990:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788869805.458993:0:22682:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1788869805.458995:0:22682:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788869805.458996:0:22682:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788869805.458997:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788869805.459000:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869805.459002:0:22682:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788869805.459004:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788869805.459009:0:22682:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788869805.459012:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869805.459014:0:22682:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788869805.459017:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788869805.459020:0:22682:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:1.0:1788869805.459045:0:22682:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788869805.459048:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788869805.459062:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e28179f8000) 00000020:00000080:1.0:1788869805.459074:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788869805.459079:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1788869805.459231:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325187712:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788869805.459306:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788869805.459678:0:22682:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788869805.459685:0:22682:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788869805.459693:0:22682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6d0338 00010000:00080000:1.0:1788869805.459723:0:22682:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2703a18000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1788869805.459944:0:22682:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1788869805.462055:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325187712 00000100:00100000:3.0:1788869805.462074:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325187712 00000100:00100000:3.0:1788869805.462124:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869805.462134:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875765325187712:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788869805.462157:0:22669:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1788869805.466518:0:22682:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788869805.466920:0:22682:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788869805.472350:0:22682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869805.474924:0:22682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1788869805.482545:0:22682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000100:00100000:3.0:1788869805.487647:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875765325187712:12345-0@lo:38:llog_process_th.0 Request processed in 25503us (28330us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788869805.487664:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:2.0:1788869805.488416:0:22688:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788869805.488423:0:22688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00080000:0.0:1788869805.489233:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e280a5b6800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869805.489255:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788869805.489260:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325187712:0@lo:38:llog_process_th.0 00000020:00000080:0.0:1788869805.490207:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788869805.490220:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788869805.490264:0:22682:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788869805.490283:0:22682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6d033f 00000100:00080000:0.0:1788869805.490291:0:22682:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869805.490302:0:22682:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e2703a18000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869805.490335:0:22682:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282f046300 x1875765325187840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869805.490363:0:22682:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788869805.490417:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869805.490422:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869805.490423:0:22682:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788869805.490426:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788869805.490429:0:22682:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1788869805.490431:0:22682:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788869805.490432:0:22682:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788869805.490434:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788869805.490444:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869805.490446:0:22682:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788869805.490449:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788869805.490453:0:22682:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788869805.490457:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869805.490458:0:22682:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788869805.490461:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788869805.490465:0:22682:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:0.0:1788869805.490489:0:22682:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788869805.490492:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869805.490515:0:22682:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e27029c8000) 00000020:00000080:0.0:1788869805.490528:0:22682:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1788869805.490533:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788869805.490621:0:22682:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788869805.490627:0:22682:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788869805.490632:0:22682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4c16c38a9b6d034d 00010000:00080000:0.0:1788869805.490660:0:22682:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2829c0c000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:0.0:1788869805.490858:0:22682:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788869805.490927:0:22682:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788869805.490942:0:22682:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788869805.491685:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325187840:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788869805.491760:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765325187840 offset 0 length 520: 4 00000040:00080000:0.0:1788869805.496486:0:22682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869805.497195:0:22682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1788869805.497343:0:22682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1788869805.502101:0:22690:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788869805.502113:0:22690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788869805.504002:0:22682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788869805.504018:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788869805.504061:0:22682:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788869805.504081:0:22682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6d0354 00000100:00080000:0.0:1788869805.504165:0:22682:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788869805.504178:0:22682:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e2829c0c000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869805.504218:0:22682:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282f044a80 x1875765325187968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788869805.504365:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325187968:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788869805.504427:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765325187968 offset 0 length 520: 4 00000100:00080000:0.0:1788869805.504486:0:22682:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788869805.504633:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869805.504639:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869805.504641:0:22682:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788869805.504644:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869805.504649:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869805.504650:0:22682:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788869805.504654:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788869805.504655:0:22682:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788869805.504658:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869805.504660:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869805.504662:0:22682:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788869805.504664:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869805.504665:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869805.504667:0:22682:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788869805.504670:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788869805.504706:0:22682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22682:1875765325188096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788869805.504763:0:22682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869805.504779:0:22682:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282a735000 going to sleep for 11 seconds 00000100:00100000:1.0:1788869805.504889:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325188096 00000100:00100000:1.0:1788869805.504897:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325188096 00000100:00100000:1.0:1788869805.504946:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869805.504955:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+9:22682:x1875765325188096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869805.505119:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+9:22682:x1875765325188096:12345-0@lo:502:llog_process_th.0 Request processed in 164us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869805.505128:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869805.505428:0:22682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22682:1875765325188096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788869805.505460:0:22682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869805.505465:0:22682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869805.505467:0:22682:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788869805.505472:0:22682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788869805.505684:0:22643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788869805.505711:0:22643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788869805.505735:0:22643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8e00/0x4c16c38a9b6d02c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d02cf expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869805.505747:0:22643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8e00/0x4c16c38a9b6d02c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d02cf expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869805.505757:0:22643:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e283b011000 from 1 10000000:01000000:2.0:1788869805.505759:0:22643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788869805.505791:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d035b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869805.505811:0:22643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d035b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869805.505821:0:22643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d035b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869805.505839:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325188224:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788869805.505873:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869805.505902:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039276c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869805.505978:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325188224 00000100:00100000:1.0:1788869805.505984:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325188224 00000100:00100000:1.0:1788869805.506011:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869805.506017:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+9:22643:x1875765325188224:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869805.506028:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869805.506042:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6d0362 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d035b expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869805.506066:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6d0362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d035b expref: 10 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869805.506077:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6d0362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d035b expref: 10 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869805.506097:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb400, rc 0) 00000100:00100000:1.0:1788869805.506128:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+10:22643:x1875765325188224:12345-0@lo:101:mount.lustre.0 Request processed in 111us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869805.506134:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788869805.506271:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325188224:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869805.506284:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d035b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0362 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869805.506293:0:22643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d035b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d0362 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869805.506879:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325188352:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788869805.506929:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869805.506954:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039276c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869805.507477:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325188352 00000100:00100000:1.0:1788869805.507487:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325188352 00000100:00100000:1.0:1788869805.507544:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788869805.507554:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+10:22643:x1875765325188352:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788869805.507578:0:22659:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788869805.507626:0:22659:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788869805.507709:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+10:22643:x1875765325188352:12345-0@lo:256:mount.lustre.0 Request processed in 155us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869805.507716:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788869805.507817:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325188352:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788869805.509080:0:22643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869805.509224:0:22643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d035b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0362 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869805.509249:0:22643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d035b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0362 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869805.509273:0:22643:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e283b011000 from 1 10000000:01000000:2.0:1788869805.509277:0:22643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788869805.509316:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d0369 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869805.509324:0:22643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d0369 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869805.509334:0:22643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d0369 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869805.509358:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325188480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788869805.509425:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869805.509472:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039276c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869805.509644:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325188480 00000100:00100000:1.0:1788869805.509654:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325188480 00000100:00100000:1.0:1788869805.509719:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869805.509728:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+10:22643:x1875765325188480:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869805.509747:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869805.509763:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840eda400/0x4c16c38a9b6d0370 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d0369 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869805.509787:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840eda400/0x4c16c38a9b6d0370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d0369 expref: 11 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869805.509799:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840eda400/0x4c16c38a9b6d0370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d0369 expref: 11 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869805.509808:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda400, rc 0) 00000100:00100000:1.0:1788869805.509859:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+11:22643:x1875765325188480:12345-0@lo:101:mount.lustre.0 Request processed in 132us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869805.509865:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788869805.510006:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325188480:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869805.510021:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d0369 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0370 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.510031:0:22643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d0369 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d0370 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869805.510126:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325188608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869805.510157:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869805.510185:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a0ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869805.510366:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325188608 00000100:00100000:1.0:1788869805.510371:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325188608 00000100:00100000:1.0:1788869805.510405:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788869805.510413:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+11:22643:x1875765325188608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869805.510575:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+11:22643:x1875765325188608:12345-0@lo:501:mount.lustre.0 Request processed in 162us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869805.510582:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788869805.510775:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325188608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869805.510807:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325188736:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869805.510851:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869805.510880:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a0ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788869805.510926:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325188736 00000100:00100000:2.0:1788869805.510931:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325188736 00000100:00100000:2.0:1788869805.510965:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869805.510972:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+11:22643:x1875765325188736:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869805.511057:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+11:22643:x1875765325188736:12345-0@lo:503:mount.lustre.0 Request processed in 85us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869805.511064:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788869805.511205:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325188736:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869805.515816:0:22692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22692:1875765325188864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869805.515946:0:22692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869805.516033:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325188864 00000100:00100000:2.0:1788869805.516045:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325188864 00000100:00100000:2.0:1788869805.516123:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869805.516134:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+11:22692:x1875765325188864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869805.516740:0:22692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869805.517017:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+11:22692:x1875765325188864:12345-0@lo:502:llog_process_th.0 Request processed in 879us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869805.517043:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788869805.517225:0:22692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22692:1875765325188864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869805.517333:0:22692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869805.517343:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869805.517346:0:22692:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788869805.517355:0:22692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e283b011000 00000020:00000080:1.0:1788869805.517357:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788869805.517365:0:22692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869805.517367:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869805.517368:0:22692:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788869805.517370:0:22692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869805.517373:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869805.517374:0:22692:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788869805.517377:0:22692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e283b011000 00000020:00000080:1.0:1788869805.517379:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788869805.517682:0:22692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869805.517687:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869805.517689:0:22692:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788869805.517691:0:22692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869805.517694:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869805.517695:0:22692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788869805.517699:0:22692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e283b011000 00000020:00000080:1.0:1788869805.517701:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788869805.522895:0:22692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869805.522911:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869805.522914:0:22692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788869805.522919:0:22692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869805.522923:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869805.522925:0:22692:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788869805.522931:0:22692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e283b011000 00000020:00000080:1.0:1788869805.522960:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788869805.523061:0:22692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22692:1875765325188992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869805.523173:0:22692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869805.523225:0:22692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869805.523458:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325188992 00000100:00100000:2.0:1788869805.523468:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325188992 00000100:00100000:2.0:1788869805.523531:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788869805.523541:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+11:22692:x1875765325188992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869805.523707:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+11:22692:x1875765325188992:12345-0@lo:502:llog_process_th.0 Request processed in 167us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869805.523715:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788869805.525117:0:22692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22692:1875765325188992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788869805.525165:0:22692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869805.525175:0:22692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869805.525177:0:22692:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788869805.525182:0:22692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788869805.525377:0:22643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788869805.525402:0:22643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788869805.525431:0:22643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d0369 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0370 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.525444:0:22643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d0369 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0370 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869805.525494:0:22643:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788869805.525497:0:22643:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e283b011000 10000000:01000000:3.0:1788869805.525500:0:22643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e283b011000 10000000:01000000:3.0:1788869805.525516:0:22643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788869805.525521:0:22643:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e283b011000 from 1 10000000:01000000:3.0:1788869805.525525:0:22643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788869805.525556:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9e00/0x4c16c38a9b6d0377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.525565:0:22643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9e00/0x4c16c38a9b6d0377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.525625:0:22643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9e00/0x4c16c38a9b6d0377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869805.525653:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325189120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788869805.525726:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869805.525768:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e46240 going to sleep for 11 seconds 00000100:00100000:1.0:1788869805.526209:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325189120 00000100:00100000:1.0:1788869805.526216:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325189120 00000100:00100000:1.0:1788869805.526268:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869805.526278:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+11:22643:x1875765325189120:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869805.526292:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869805.526307:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edb200/0x4c16c38a9b6d037e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d0377 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869805.526332:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edb200/0x4c16c38a9b6d037e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d0377 expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869805.526342:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edb200/0x4c16c38a9b6d037e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d0377 expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869805.526351:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb200, rc 0) 00000100:00100000:1.0:1788869805.526402:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:22643:x1875765325189120:12345-0@lo:101:mount.lustre.0 Request processed in 126us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869805.526410:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788869805.526630:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325189120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869805.526644:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9e00/0x4c16c38a9b6d0377 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d037e expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.526654:0:22643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9e00/0x4c16c38a9b6d0377 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d037e expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869805.526737:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325189248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869805.526766:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869805.526800:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e46240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869805.526853:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325189248 00000100:00100000:2.0:1788869805.526858:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325189248 00000100:00100000:2.0:1788869805.526888:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788869805.526895:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:22643:x1875765325189248:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869805.527033:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:22643:x1875765325189248:12345-0@lo:501:mount.lustre.0 Request processed in 138us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869805.527042:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788869805.528405:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325189248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869805.528460:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325189376:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869805.528530:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869805.528564:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e46240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869805.529064:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325189376 00000100:00100000:2.0:1788869805.529072:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325189376 00000100:00100000:2.0:1788869805.529137:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788869805.529146:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:22643:x1875765325189376:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869805.529272:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:22643:x1875765325189376:12345-0@lo:503:mount.lustre.0 Request processed in 125us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869805.529279:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788869805.529544:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325189376:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869805.531208:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22693:1875765325189504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788869805.531410:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869805.531449:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e46300 going to sleep for 11 seconds 00000100:00100000:2.0:1788869805.531668:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325189504 00000100:00100000:2.0:1788869805.531676:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325189504 00000100:00100000:2.0:1788869805.531721:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788869805.531730:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:22693:x1875765325189504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869805.536344:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:22693:x1875765325189504:12345-0@lo:502:llog_process_th.0 Request processed in 4605us (4924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869805.536361:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869805.541381:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22693:1875765325189504:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788869805.541478:0:22693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788869805.541496:0:22693:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8e283d3e19c0) 00000020:00000080:1.0:1788869805.543077:0:22693:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1788869805.543519:0:22693:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e283b011000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788869805.543525:0:22693:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e283b011000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788869805.543529:0:22693:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e283b011000 4 00010000:00080000:1.0:1788869805.543567:0:22693:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e280a5b5000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1788869805.554872:0:22693:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1788869805.555114:0:22693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788869805.555160:0:22693:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788869805.555173:0:22693:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4c16c38a9b6d038c 00000100:00080000:1.0:1788869805.555184:0:22693:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788869805.555196:0:22693:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e280a5b5000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869805.555235:0:22693:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27038e8380 x1875765325189632/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869805.560472:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765325189632:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788869805.560555:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788869805.560639:0:22693:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788869805.561201:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325189632 00000100:00100000:2.0:1788869805.561213:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325189632 00000100:00100000:2.0:1788869805.561580:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869805.561606:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875765325189632:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788869805.561682:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875765325189632:12345-0@lo:38:llog_process_th.0 Request processed in 76us (1126us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788869805.561689:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869805.562445:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788869805.562460:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e280a5b5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788869805.562467:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788869805.562471:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765325189632:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788869805.564312:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22693:1875765325189760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869805.564402:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869805.564449:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325189760 00000100:00100000:1.0:1788869805.564457:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325189760 00000100:00100000:1.0:1788869805.564525:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788869805.564534:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:22693:x1875765325189760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869805.564689:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:22693:x1875765325189760:12345-0@lo:502:llog_process_th.0 Request processed in 156us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869805.564696:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788869805.564754:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1240 going to sleep for 11 seconds 00000100:00100000:1.0:1788869805.564774:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22693:1875765325189760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869805.564831:0:22693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22693:1875765325189888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788869805.564862:0:22693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869805.564884:0:22693:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869805.565200:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325189888 00000100:00100000:2.0:1788869805.565205:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325189888 00000100:00100000:2.0:1788869805.565235:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869805.565243:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:22693:x1875765325189888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788869805.565323:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:22693:x1875765325189888:12345-0@lo:502:llog_process_th.0 Request processed in 80us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869805.565330:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788869805.568827:0:22693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22693:1875765325189888:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788869805.568890:0:22693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788869805.568982:0:22643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788869805.569012:0:22643:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788869805.569029:0:22643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9e00/0x4c16c38a9b6d0377 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d037e expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869805.569042:0:22643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9e00/0x4c16c38a9b6d0377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d037e expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788869805.569120:0:22643:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788869805.569122:0:22643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788869805.569124:0:22643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869805.569125:0:22643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869805.569127:0:22643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869805.569128:0:22643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869805.569130:0:22643:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869805.569131:0:22643:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788869805.569132:0:22643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869805.569134:0:22643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788869805.569137:0:22643:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788869805.569140:0:22643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788869805.569141:0:22643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788869805.569142:0:22643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869805.569143:0:22643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869805.569144:0:22643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869805.569146:0:22643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869805.569146:0:22643:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869805.569147:0:22643:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788869805.569148:0:22643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869805.569149:0:22643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788869805.569180:0:22643:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788869805.569200:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325190016:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788869805.569262:0:22643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869805.569295:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28411c4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869805.570624:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325190016 00000100:00100000:1.0:1788869805.570637:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325190016 00000100:00100000:1.0:1788869805.570700:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788869805.570710:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:22643:x1875765325190016:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788869805.570749:0:22659:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788869805.570767:0:22659:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788869805.584533:0:22659:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788869805.584560:0:22659:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788869805.584832:0:22680:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788869805.584838:0:22680:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788869805.584868:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d0393 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869805.584892:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6d0362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d035b expref: 12 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869805.584901:0:22680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d0393 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869805.584955:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6d0362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6d035b expref: 12 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869805.584970:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6d0362 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6d035b expref: 12 pid: 22658 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869805.584985:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875765325190144:0@lo:104: 00000100:00100000:2.0:1788869805.585050:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869805.585112:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28411c40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869805.585276:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:22643:x1875765325190016:12345-0@lo:253:mount.lustre.0 Request processed in 14566us (16013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869805.585288:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788869805.585422:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22643:1875765325190016:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788869805.585435:0:22643:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788869805.585438:0:22643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788869805.585441:0:22643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788869805.585442:0:22643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869805.585444:0:22643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869805.585445:0:22643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869805.585446:0:22643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869805.585448:0:22643:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869805.585450:0:22643:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788869805.585451:0:22643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869805.585453:0:22643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788869805.585469:0:22643:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788869805.593222:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325190144 00000100:00100000:0.0:1788869805.593241:0:22647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325190144 00000100:00100000:0.0:1788869805.593299:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869805.593311:0:22647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+3:22680:x1875765325190144:12345-0@lo:104: 00010000:00010000:0.0:1788869805.593333:0:22647:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d035b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d0362 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869805.593475:0:22647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788869805.593482:0:22647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+3:22680:x1875765325190144:12345-0@lo:104: Request processed in 174us (8432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869805.593490:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788869805.593523:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869805.593529:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d035b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d0362 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869805.593537:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842042400 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:0.0:1788869805.593542:0:22653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d035b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6d0362 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869805.593552:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d035b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6d0362 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788869805.593559:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d035b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6d0362 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869805.593565:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788869805.593627:0:22653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d035b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d0362 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869805.593634:0:22653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788869805.593656:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d035b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d0362 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869805.593662:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d035b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d0362 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869805.593692:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869805.593694:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869805.593695:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869805.593736:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325190272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869805.593778:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869805.594206:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875765325190144:0@lo:104: 00010000:00010000:3.0:1788869805.594235:0:22680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d0393 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869805.594995:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325190272 00000100:00100000:3.0:1788869805.595004:0:22649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325190272 00010000:00010000:3.0:1788869805.595036:0:22649:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6d0362 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d035b expref: 12 pid: 22658 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869805.595072:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869805.595080:0:22649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:3650:x1875765325190272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869805.595108:0:22649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869805.595114:0:22649:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6d0362 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d035b expref: 12 pid: 22658 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.595125:0:22649:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6d0362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6d035b expref: 12 pid: 22658 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.595142:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edb400/0x4c16c38a9b6d0362 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6d035b expref: 12 pid: 22658 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.595159:0:22649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d0393 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.595168:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d0393 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788869805.595198:0:22649:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010361026s 00010000:00010000:3.0:1788869805.595204:0:22649:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d0393 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.595212:0:22649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d0393 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.595219:0:22649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d0393 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.595227:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d0393 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.595233:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842042600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869805.595237:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d0393 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.595259:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d0393 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.595278:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d0393 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869805.595289:0:22649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869805.595351:0:22649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+11:3650:x1875765325190272:12345-0@lo:103:ldlm_bl.0 Request processed in 271us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869805.595359:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869805.597310:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325190272:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788869805.597356:0:22680:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d0393 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869805.597368:0:22680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d0393 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869805.597376:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d0393 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788869805.619982:0:22643:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:2.0:1788869805.620405:0:22643:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788869805.620755:0:22705:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1788869805.621072:0:22705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869805.623120:0:22705:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788869805.623209:0:22705:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000020:00080000:3.0:1788869805.623857:0:22704:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:3.0:1788869805.623864:0:22704:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:2.0:1788869805.624235:0:22643:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:2.0:1788869805.626162:0:22706:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8e270402f800 x1875765325190400/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869805.626178:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00000040:01000000:3.0:1788869805.626788:0:22643:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788869805.626828:0:22643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788869805.630329:0:22643:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788869805.630355:0:22643:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788869805.630454:0:22643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788869805.631448:0:22643:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788869805.632025:0:22643:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788869805.632060:0:22643:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788869805.642026:0:22643:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1788869805.642843:0:22643:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:3.0:1788869805.648696:0:22643:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1788869805.655417:0:22643:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788869805.655461:0:22643:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb9f6817e3988 00100000:10000000:3.0:1788869805.655470:0:22643:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788869805.656578:0:22643:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788869805.656618:0:22643:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788869805.656640:0:22643:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788869805.656672:0:22643:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788869805.663090:0:22643:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869805.663365:0:22643:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788869806.021792:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788869806.601362:0:22700:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788869806.601376:0:22700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788869806.604226:0:22700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788869806.604242:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788869806.664707:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 10000000:01000000:0.0:1788869806.917684:0:22661:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788869806.917692:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e283b011000 from 11 10000000:01000000:0.0:1788869806.917700:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788869806.917759:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d039a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869806.917773:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d039a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869806.917785:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d039a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869806.917823:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325190528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869806.917947:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869806.917993:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2826884cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869806.918075:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325190528 00000100:00100000:2.0:1788869806.918084:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325190528 00000100:00100000:2.0:1788869806.918219:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788869806.918228:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+11:22661:x1875765325190528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869806.918241:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869806.918255:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d03a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d039a expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869806.918280:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d03a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d039a expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869806.918291:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d03a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d039a expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869806.918299:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842042600, rc 0) 00000100:00100000:2.0:1788869806.918347:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:22661:x1875765325190528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869806.918353:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788869806.921915:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325190528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869806.921951:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d039a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d03a1 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869806.921965:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d039a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d03a1 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869806.922087:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325190656:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788869806.922311:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869806.922367:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1600 going to sleep for 11 seconds 00000100:00100000:2.0:1788869806.922629:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325190656 00000100:00100000:2.0:1788869806.922638:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325190656 00000100:00100000:2.0:1788869806.922700:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869806.922712:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:22661:x1875765325190656:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788869806.922738:0:22659:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788869806.922760:0:22659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788869806.922763:0:22659:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788869806.922865:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:22661:x1875765325190656:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 154us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869806.922873:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869806.922925:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325190656:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788869806.922976:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869806.922992:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d039a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d03a1 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869806.923003:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d039a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d03a1 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869807.045801:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788869807.622367:0:22700:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788869807.622377:0:22700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788869807.622572:0:22700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1788869807.622648:0:22700:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788869807.622817:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1788869807.689051:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00010000:00010000:2.0:1788869808.080890:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869808.712391:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00010000:00010000:0.0:1788869809.097141:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869809.736275:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00010000:00010000:3.0:1788869810.117790:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869810.760718:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00000100:00100000:3.0:1788869811.013989:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3651:1875765325190784:0@lo:400:kworker.0 00000100:00100000:3.0:1788869811.014068:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788869811.014410:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788869811.014416:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788869811.014420:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e280a5b6800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869811.014426:0:475:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 739 00000100:00080000:0.0:1788869811.014432:0:475:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788869811.014442:0:475:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e280a5b6800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869811.014468:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282f045c00 x1875765325190912/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869811.014486:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869811.014490:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869811.014493:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869811.014496:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869811.014498:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788869811.014510:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788869811.014512:0:475:0:(import.c:65:import_set_state_nolock()) ffff8e280a5b5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869811.014518:0:475:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e280a5b5000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869811.014532:0:475:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282f047480 x1875765325191040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788869811.014561:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325190784 00000100:00100000:0.0:1788869811.014567:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325190784 00000100:00100000:0.0:1788869811.014628:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869811.014638:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:3651:x1875765325190784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869811.021597:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:3651:x1875765325190784:12345-0@lo:400:kworker.0 Request processed in 6937us (7506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869811.021615:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869811.021706:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325190912:0@lo:38:kworker.0 00000100:00100000:0.0:1788869811.021785:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869811.021818:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765325191040:0@lo:38:kworker.0 00000100:00100000:0.0:1788869811.021860:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869811.021968:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325190912 00000100:00100000:1.0:1788869811.021977:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325190912 00000100:00100000:1.0:1788869811.022014:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788869811.022021:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875765325190912:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788869811.022042:0:22670:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788869811.022087:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875765325190912:12345-0@lo:38:kworker.0 Request processed in 65us (302us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788869811.022093:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788869811.022176:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e280a5b6800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869811.022182:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788869811.022186:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325190912:0@lo:38:kworker.0 00000100:00100000:2.0:1788869811.022275:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325191040 00000100:00100000:2.0:1788869811.022281:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325191040 00000100:00100000:2.0:1788869811.022301:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788869811.022439:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875765325191040:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788869811.022460:0:22666:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 744 last 0 00000020:00000080:2.0:1788869811.022498:0:22666:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4c16c38a9b6d03a8 00000004:00100000:2.0:1788869811.022513:0:22666:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788869811.022720:0:22666:0:(import.c:65:import_set_state_nolock()) ffff8e2702583000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869811.022816:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875765325191040:12345-0@lo:38:kworker.0 Request processed in 508us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869811.022823:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869811.025002:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3651:1875765325190784:0@lo:400:kworker.0 00010000:00080000:0.0:1788869811.025291:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e282f047480 x1875765325191040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788869811.025396:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788869811.025407:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788869811.025415:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788869811.025419:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e280a5b5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788869811.025440:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875765325191040:0@lo:38:kworker.0 00010000:00010000:0.0:1788869811.142281:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788869811.478545:0:22949:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788869811.782766:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00010000:00010000:3.0:1788869812.183943:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788869812.597372:0:23001:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869812.599100:0:23001:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788869812.806654:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00010000:00010000:1.0:1788869813.198070:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788869813.562321:0:23051:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869813.562897:0:23051:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788869813.831774:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00010000:00010000:3.0:1788869814.216410:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869814.853944:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00000100:00100000:2.0:1788869815.110118:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869805/real 1788869805] req@ffff8e282f044a80 x1875765325187968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869815 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869815.110153:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e282f044a80 x1875765325187968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869815 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869815.110163:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869805/real 1788869805] req@ffff8e282f046300 x1875765325187840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869815 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869815.110194:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e282f046300 x1875765325187840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869815 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788869815.110214:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2829c0c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869815.110243:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788869815.110247:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325187968:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788869815.110253:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2703a18000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869815.110257:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788869815.110260:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325187840:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788869815.110675:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788869815.110681:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788869815.110684:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e280a5b6800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869815.110690:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 744 00000100:00080000:3.0:1788869815.110696:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788869815.110708:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e280a5b6800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869815.110730:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e280138d880 x1875765325191296/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869815.110742:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869815.110745:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788869815.110747:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e2703a18000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869815.110750:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 739 00000100:00080000:3.0:1788869815.110752:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788869815.110757:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e2703a18000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869815.110768:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e280138f100 x1875765325191424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869815.110776:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869815.110779:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788869815.110781:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e2829c0c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869815.110784:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 739 00000100:00080000:3.0:1788869815.110786:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788869815.110791:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e2829c0c000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869815.110801:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e280138f800 x1875765325191552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869815.110998:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325191680:0@lo:400:kworker.0 00000100:00100000:1.0:1788869815.111063:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869815.111180:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325191680 00000100:00100000:3.0:1788869815.111190:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325191680 00000100:00100000:3.0:1788869815.111233:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788869815.111243:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325191680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869815.111308:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325191680:12345-0@lo:400:kworker.0 Request processed in 66us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869815.111315:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788869815.112466:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e280138d180 x1875765325191680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869815.112485:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325191680:0@lo:400:kworker.0 00000100:00100000:1.0:1788869815.112512:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869815.112520:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3649:1875765325191168:0@lo:400:kworker.0 00000100:00100000:1.0:1788869815.112566:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869815.112642:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325191168 00000100:00100000:3.0:1788869815.112648:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325191168 00000100:00100000:2.0:1788869815.112737:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325191296:0@lo:38:kworker.0 00000100:00100000:2.0:1788869815.112770:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869815.117956:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325191424:0@lo:8:kworker.0 00000400:00000100:2.0:1788869815.118030:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765325191424 offset 0 length 520: 4 00000100:00100000:2.0:1788869815.118062:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325191552:0@lo:8:kworker.0 00000400:00000100:2.0:1788869815.118110:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765325191552 offset 0 length 520: 4 00000100:00100000:2.0:1788869815.118150:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325191296 00000100:00100000:2.0:1788869815.118159:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325191296 00000100:00100000:2.0:1788869815.118207:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869815.118216:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875765325191296:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788869815.118238:0:22670:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788869815.118542:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875765325191296:12345-0@lo:38:kworker.0 Request processed in 324us (5768us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788869815.118551:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788869815.121228:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788869815.121260:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:3649:x1875765325191168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869815.121552:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:3649:x1875765325191168:12345-0@lo:400:kworker.0 Request processed in 309us (8985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869815.121561:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788869815.121833:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3649:1875765325191168:0@lo:400:kworker.0 00000100:00080000:0.0:1788869815.121981:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e280a5b6800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869815.121988:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788869815.121992:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325191296:0@lo:38:kworker.0 00010000:00010000:2.0:1788869815.241111:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869815.879843:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00010000:00010000:1.0:1788869816.262917:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869816.901761:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00010000:00010000:1.0:1788869817.286917:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788869817.863189:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788869817.925869:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00010000:00010000:1.0:1788869818.310901:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869818.950370:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00010000:00010000:1.0:1788869819.340912:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869819.973670:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00000100:00080000:3.0:1788869820.230555:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788869820.230565:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788869820.230570:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e280a5b6800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869820.230582:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 749 00000100:00080000:3.0:1788869820.230764:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788869820.230779:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e280a5b6800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869820.230812:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e280138e680 x1875765325191936/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869820.230838:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869820.230842:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869820.230845:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869820.230848:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788869820.230878:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325191808:0@lo:400:kworker.0 00000100:00100000:1.0:1788869820.230879:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325191936:0@lo:38:kworker.0 00000100:00100000:3.0:1788869820.232324:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869820.232405:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869820.232416:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325192064:0@lo:400:kworker.0 00000100:00100000:3.0:1788869820.232457:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869820.232513:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325192064 00000100:00100000:3.0:1788869820.232522:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325192064 00000100:00100000:3.0:1788869820.232610:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869820.232621:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325192064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869820.232680:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325192064:12345-0@lo:400:kworker.0 Request processed in 61us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869820.232686:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788869820.233065:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e280138df80 x1875765325192064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869820.233081:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325192064:0@lo:400:kworker.0 00000100:00100000:2.0:1788869820.233182:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325191808 00000100:00100000:2.0:1788869820.233187:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325191808 00000100:00100000:2.0:1788869820.233231:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788869820.233240:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:3650:x1875765325191808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869820.233284:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:3650:x1875765325191808:12345-0@lo:400:kworker.0 Request processed in 46us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869820.233301:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788869820.233511:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325191808:0@lo:400:kworker.0 00000100:00100000:1.0:1788869820.236050:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869820.236190:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325191936 00000100:00100000:3.0:1788869820.236201:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325191936 00000100:00100000:3.0:1788869820.236242:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869820.236249:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875765325191936:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788869820.236271:0:22669:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788869820.236335:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875765325191936:12345-0@lo:38:kworker.0 Request processed in 84us (293us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788869820.236343:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788869820.236662:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e280a5b6800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869820.236670:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788869820.236674:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325191936:0@lo:38:kworker.0 00010000:00010000:1.0:1788869820.357784:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869821.005200:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00010000:00010000:1.0:1788869821.384493:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788869821.534914:0:23397:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788869821.534920:0:23397:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788869821.534922:0:23397:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788869821.535045:0:23397:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e2704079800 00000020:01000004:2.0:1788869821.535064:0:23397:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788869821.535076:0:23397:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788869821.535092:0:23397:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8e283b578000) 00000020:00000080:2.0:1788869821.535402:0:23397:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788869821.622623:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788869821.622914:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788869821.624782:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788869821.625290:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788869821.625525:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788869821.625903:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788869821.626242:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788869821.626523:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788869821.627365:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788869821.628737:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788869821.629227:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788869821.629434:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788869821.629758:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788869821.629944:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788869821.631841:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788869821.632237:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788869821.632444:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788869821.632981:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788869821.633343:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788869821.633537:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788869821.633914:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788869821.634258:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788869821.634448:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788869821.634677:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788869821.634910:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788869821.635277:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788869821.635478:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788869821.635780:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788869821.635962:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788869821.636309:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788869821.636495:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788869821.636737:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788869821.636924:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788869821.637182:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788869821.642017:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788869821.642492:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788869821.642851:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788869821.643093:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788869821.643311:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788869821.643515:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788869821.643928:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788869821.644250:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788869821.644564:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788869821.645084:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788869821.645308:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788869821.645502:0:23397:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:01000000:2.0:1788869821.652771:0:23397:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788869821.653079:0:23397:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788869821.653236:0:23397:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788869821.653249:0:23397:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4c16c38a9b6d03b6 00000020:01000004:2.0:1788869821.653261:0:23397:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788869821.653289:0:23397:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788869821.653293:0:23397:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788869821.653316:0:23397:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788869821.653352:0:23397:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788869821.653357:0:23397:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788869821.667915:0:23397:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788869821.667979:0:23397:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.154@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1788869821.667984:0:23397:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788869821.667986:0:23397:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788869821.667987:0:23397:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869821.667989:0:23397:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869821.667990:0:23397:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869821.667991:0:23397:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869821.667992:0:23397:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788869821.667994:0:23397:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869821.667996:0:23397:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788869821.668000:0:23397:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1788869821.668002:0:23397:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788869821.668004:0:23397:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788869821.668005:0:23397:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869821.668006:0:23397:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869821.668007:0:23397:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869821.668008:0:23397:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869821.668009:0:23397:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788869821.668010:0:23397:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869821.668011:0:23397:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788869821.668057:0:23397:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788869821.668099:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325192192:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788869821.668195:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869821.668248:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280833d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788869821.668483:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325192192 00000100:00100000:2.0:1788869821.668492:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325192192 00000100:00100000:2.0:1788869821.668559:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788869821.668569:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:23397:x1875765325192192:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788869821.669000:0:22657:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788869821.669004:0:22657:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788869821.669014:0:22657:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788869821.670285:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:23397:x1875765325192192:12345-0@lo:253:mount.lustre.0 Request processed in 1709us (2081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869821.670301:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788869821.670434:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325192192:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788869821.670448:0:23397:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788869821.670451:0:23397:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788869821.670452:0:23397:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788869821.670454:0:23397:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869821.670456:0:23397:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869821.670457:0:23397:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869821.670458:0:23397:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869821.670460:0:23397:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788869821.670461:0:23397:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869821.670462:0:23397:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788869821.670485:0:23397:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e2704079800 from lustre-MDT0001 10000000:01000000:1.0:1788869821.670530:0:23397:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788869821.670534:0:23397:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788869821.670541:0:23397:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e27029cb380 local copy 00010000:00010000:1.0:1788869821.670553:0:23397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9800/0x4c16c38a9b6d02ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d02b3 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869821.671265:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325192320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869821.671335:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869821.671453:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280833d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788869821.676256:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325192320 00000100:00100000:3.0:1788869821.676274:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325192320 00000100:00100000:3.0:1788869821.676362:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788869821.676377:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:23397:x1875765325192320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869821.676571:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:23397:x1875765325192320:12345-0@lo:501:mount.lustre.0 Request processed in 197us (5235us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788869821.676580:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788869821.676913:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325192320:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788869821.676938:0:23397:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788869821.676969:0:23397:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788869821.676979:0:23397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9800/0x4c16c38a9b6d02ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d02b3 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869821.677012:0:23397:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9800/0x4c16c38a9b6d02ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d02b3 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869821.677047:0:23397:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e2704079800 10000000:01000000:1.0:1788869821.677053:0:23397:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788869821.677059:0:23397:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e27029cb380 10000000:01000000:1.0:1788869821.677062:0:23397:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788869821.677065:0:23397:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e27029cb380 from 1 10000000:01000000:1.0:1788869821.677069:0:23397:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788869821.677121:0:23397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6d03bd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869821.677130:0:23397:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6d03bd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869821.677140:0:23397:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6d03bd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869821.677163:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325192448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788869821.677208:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869821.677249:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280833d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869821.677362:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325192448 00000100:00100000:2.0:1788869821.677370:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325192448 00000100:00100000:2.0:1788869821.677402:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788869821.677411:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+12:23397:x1875765325192448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869821.677423:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869821.677439:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2842043c00/0x4c16c38a9b6d03c4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d03bd expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869821.677463:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2842043c00/0x4c16c38a9b6d03c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d03bd expref: 13 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869821.677473:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2842043c00/0x4c16c38a9b6d03c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d03bd expref: 13 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869821.677481:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842043c00, rc 0) 00000100:00100000:2.0:1788869821.677531:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+13:23397:x1875765325192448:12345-0@lo:101:mount.lustre.0 Request processed in 121us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869821.677547:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788869821.678000:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325192448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869821.678016:0:23397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6d03bd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d03c4 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869821.678025:0:23397:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6d03bd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d03c4 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869821.678056:0:23397:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788869821.678078:0:23397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6d03bd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d03c4 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869821.678097:0:23397:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840eda000/0x4c16c38a9b6d03bd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d03c4 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869821.678125:0:23397:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e2704079800 10000000:01000000:1.0:1788869821.678131:0:23397:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788869821.678137:0:23397:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e2704079800 from 1 10000000:01000000:1.0:1788869821.678140:0:23397:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788869821.678161:0:23397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6d03cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869821.678169:0:23397:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6d03cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869821.678180:0:23397:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6d03cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869821.678197:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325192576:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788869821.678240:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869821.678266:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280833d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788869821.679576:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325192576 00000100:00100000:0.0:1788869821.679630:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325192576 00000100:00100000:0.0:1788869821.679702:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788869821.679712:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+13:23397:x1875765325192576:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869821.679728:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869821.679744:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbb5a00/0x4c16c38a9b6d03d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d03cb expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869821.679769:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb5a00/0x4c16c38a9b6d03d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d03cb expref: 14 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869821.679779:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbb5a00/0x4c16c38a9b6d03d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d03cb expref: 14 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869821.679788:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5a00, rc 0) 00000100:00100000:0.0:1788869821.679848:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+14:23397:x1875765325192576:12345-0@lo:101:mount.lustre.0 Request processed in 138us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869821.679867:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788869821.680337:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325192576:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869821.680356:0:23397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6d03cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d03d2 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869821.680365:0:23397:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6d03cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d03d2 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869821.680394:0:23397:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788869821.680413:0:23397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6d03cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d03d2 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869821.680422:0:23397:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840edb800/0x4c16c38a9b6d03cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d03d2 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869821.680431:0:23397:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788869821.680437:0:23397:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788869821.680443:0:23397:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e2704079800 10000000:01000000:1.0:1788869821.680446:0:23397:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788869821.680450:0:23397:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788869821.680453:0:23397:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788869821.680478:0:23397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6d03d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869821.680485:0:23397:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6d03d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869821.680494:0:23397:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6d03d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869821.680525:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325192704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788869821.680566:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869821.680636:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280833d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788869821.680804:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325192704 00000100:00100000:3.0:1788869821.680810:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325192704 00000100:00100000:3.0:1788869821.680852:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788869821.680861:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+14:23397:x1875765325192704:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869821.680871:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869821.680881:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840ed9600/0x4c16c38a9b6d03e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d03d9 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869821.680904:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed9600/0x4c16c38a9b6d03e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d03d9 expref: 15 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869821.680912:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840ed9600/0x4c16c38a9b6d03e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d03d9 expref: 15 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869821.680919:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9600, rc 0) 00000100:00100000:3.0:1788869821.680958:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+15:23397:x1875765325192704:12345-0@lo:101:mount.lustre.0 Request processed in 99us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869821.680964:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788869821.681230:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325192704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869821.681242:0:23397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6d03d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d03e0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869821.681257:0:23397:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6d03d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d03e0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788869821.684027:0:23397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1788869821.685680:0:23397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788869821.699968:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788869821.700037:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1788869821.700055:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1788869821.700070:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1788869821.700549:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1788869821.700575:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1788869821.700876:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1788869821.700897:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1788869821.700910:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1788869821.700925:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1788869821.700938:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1788869821.700953:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1788869821.700967:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1788869821.700982:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1788869821.700995:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1788869821.701007:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1788869821.701020:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1788869821.701033:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1788869821.701046:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1788869821.701057:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1788869821.701068:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1788869821.701080:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1788869821.701611:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1788869821.701640:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1788869821.701654:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1788869821.701666:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1788869821.701878:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1788869821.701895:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1788869821.701910:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1788869821.701922:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1788869821.701932:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1788869821.701943:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1788869821.701954:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1788869821.701968:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1788869821.701981:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1788869821.701993:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1788869821.702003:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1788869821.702016:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1788869821.702030:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1788869821.702044:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1788869821.702059:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1788869821.702074:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1788869821.702903:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1788869821.702937:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1788869821.702973:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1788869821.702980:0:23397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1788869821.704292:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325192832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869821.704387:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869821.704820:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280833d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869821.708333:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325192832 00000100:00100000:2.0:1788869821.708355:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325192832 00000100:00100000:3.0:1788869821.708522:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788869821.708532:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+15:23397:x1875765325192832:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869821.709038:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+15:23397:x1875765325192832:12345-0@lo:501:mount.lustre.0 Request processed in 507us (4650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869821.709046:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788869821.709330:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325192832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869821.709387:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325192960:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869821.709447:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869821.709540:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280833d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788869821.709976:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325192960 00000100:00100000:0.0:1788869821.709985:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325192960 00000100:00100000:0.0:1788869821.710063:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788869821.710073:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+15:23397:x1875765325192960:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869821.711014:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+15:23397:x1875765325192960:12345-0@lo:503:mount.lustre.0 Request processed in 940us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869821.711025:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788869821.711165:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325192960:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788869821.717888:0:23397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788869821.717995:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325193088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869821.718117:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869821.729454:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27040b8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869821.734698:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325193088 00000100:00100000:1.0:1788869821.734732:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325193088 00000100:00100000:1.0:1788869821.734805:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788869821.734834:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+15:23397:x1875765325193088:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869821.738153:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+15:23397:x1875765325193088:12345-0@lo:502:mount.lustre.0 Request processed in 3312us (20042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869821.738171:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788869821.738221:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325193088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788869821.738512:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788869821.738550:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1788869821.738565:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1788869821.738578:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1788869821.738630:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1788869821.738642:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1788869821.738652:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1788869821.738663:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1788869821.738675:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1788869821.738685:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1788869821.738711:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1788869821.738728:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1788869821.738746:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1788869821.738760:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1788869821.738772:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1788869821.738785:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1788869821.738798:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1788869821.738811:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1788869821.738822:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1788869821.738834:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1788869821.738845:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1788869821.738859:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1788869821.738871:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1788869821.738883:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1788869821.738894:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1788869821.738905:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1788869821.738916:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1788869821.738931:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1788869821.738944:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1788869821.738956:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1788869821.738967:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1788869821.738978:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1788869821.738987:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1788869821.738998:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1788869821.739009:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1788869821.739023:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1788869821.739036:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1788869821.739060:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1788869821.739075:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1788869821.739089:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1788869821.739119:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1788869821.739135:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1788869821.739146:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1788869821.739157:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1788869821.739197:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325193216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869821.739263:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869821.739304:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27040b8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869821.743917:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325193216 00000100:00100000:1.0:1788869821.743940:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325193216 00000100:00100000:1.0:1788869821.744022:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788869821.744035:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+15:23397:x1875765325193216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869821.744259:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+15:23397:x1875765325193216:12345-0@lo:502:mount.lustre.0 Request processed in 226us (4995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869821.744267:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788869821.745794:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325193216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788869821.745905:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1788869821.745920:0:23397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788869821.750889:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869821.750909:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869821.750913:0:23401:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788869821.750921:0:23401:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788869821.750924:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788869821.750946:0:23401:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8e283d3e3380) 00000020:00000080:1.0:1788869821.750972:0:23401:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788869821.750979:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788869821.751075:0:23401:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788869821.751094:0:23401:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4c16c38a9b6d03ee 00000020:00000080:1.0:1788869821.751367:0:23401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788869821.751373:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788869821.751377:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869821.751379:0:23401:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788869821.751381:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788869821.751385:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869821.751386:0:23401:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788869821.751389:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788869821.751411:0:23401:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8e283d3e0000) 00000020:00000080:1.0:1788869821.751422:0:23401:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788869821.751427:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788869821.751429:0:23401:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788869821.751432:0:23401:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788869821.751439:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788869821.751514:0:23401:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2704079800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788869821.751526:0:23401:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8e283d3e4d40) 00000020:00000080:1.0:1788869821.751536:0:23401:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788869821.751614:0:23401:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788869821.751620:0:23401:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6d0403 00000020:00000080:3.0:1788869821.751790:0:23401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788869821.751798:0:23401:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788869821.751805:0:23401:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x4c16c38a9b6d040a 00080000:01000000:3.0:1788869821.751812:0:23401:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788869821.751817:0:23401:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4c16c38a9b6d0411 00010000:00010000:2.0:1788869821.877912:0:23401:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788869821.881376:0:23401:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1788869821.882755:0:23401:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788869821.898532:0:23401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788869821.898546:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869821.898603:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869821.898606:0:23401:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788869821.898610:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869821.898616:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869821.898618:0:23401:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788869821.898621:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788869821.898627:0:23401:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:00000080:0.0:1788869821.898656:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788869821.898672:0:23401:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8e27029ccd40) 00000020:00000080:0.0:1788869821.898696:0:23401:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1788869821.898700:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788869821.898773:0:23401:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788869821.898779:0:23401:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788869821.898786:0:23401:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4c16c38a9b6d041f 00010000:00080000:0.0:1788869821.898816:0:23401:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e282d8ca000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.154@tcp at head 00010000:00010000:0.0:1788869821.900467:0:23401:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1788869821.918926:0:23401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788869821.918949:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788869821.919002:0:23401:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788869821.919036:0:23401:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6d0426 00000100:00080000:2.0:1788869821.919051:0:23401:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869821.919065:0:23401:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8e282d8ca000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869821.919136:0:23401:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e270402f100 x1875765325193344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869821.919166:0:23401:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788869821.919223:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869821.919227:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869821.919229:0:23401:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788869821.919232:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788869821.919235:0:23401:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788869821.919236:0:23401:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788869821.919238:0:23401:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788869821.919239:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788869821.919241:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869821.919243:0:23401:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788869821.919245:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869821.919249:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869821.919251:0:23401:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788869821.919254:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788869821.919282:0:23401:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788869821.919307:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869821.919311:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869821.919312:0:23401:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788869821.919315:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788869821.919317:0:23401:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788869821.919318:0:23401:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788869821.919320:0:23401:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788869821.919321:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788869821.919323:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869821.919325:0:23401:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788869821.919328:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788869821.919331:0:23401:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788869821.919335:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869821.919336:0:23401:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788869821.919339:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788869821.919343:0:23401:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:2.0:1788869821.919367:0:23401:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788869821.919371:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788869821.919387:0:23401:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8e2840a38000) 00000020:00000080:2.0:1788869821.919399:0:23401:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788869821.919405:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788869821.919473:0:23401:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788869821.919480:0:23401:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788869821.919485:0:23401:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4c16c38a9b6d0434 00000100:00100000:3.0:1788869821.919582:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325193344:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788869821.919670:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869821.919993:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325193344 00000100:00100000:3.0:1788869821.920002:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325193344 00000100:00100000:3.0:1788869821.920167:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788869821.920175:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875765325193344:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788869821.920204:0:22669:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 755 last 0 00000020:00000080:3.0:1788869821.920237:0:22669:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6d043b 00000004:00100000:3.0:1788869821.920252:0:22669:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788869821.920258:0:22669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:2.0:1788869821.920994:0:23401:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e282d8c8000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788869821.921761:0:23401:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:2.0:1788869821.922623:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788869821.922632:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788869821.922637:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e280a5b6800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788869821.922649:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 754 00000100:00080000:2.0:1788869821.922655:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788869821.922679:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e280a5b6800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869821.922727:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e270402ed80 x1875765325193472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869821.922758:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869821.922762:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869821.922766:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869821.922769:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788869821.922814:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325193600:0@lo:400:kworker.0 00000100:00100000:2.0:1788869821.922897:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869821.923025:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325193472:0@lo:38:kworker.0 00000100:00100000:0.0:1788869821.923060:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869821.924547:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325193600 00000100:00100000:2.0:1788869821.924564:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325193600 00000100:00100000:2.0:1788869821.924657:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869821.924669:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325193600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869821.924786:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325193600:12345-0@lo:400:kworker.0 Request processed in 118us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869821.924794:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788869821.924841:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e270402d880 x1875765325193600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869821.924857:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325193600:0@lo:400:kworker.0 00000040:01000000:2.0:1788869821.928032:0:23401:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788869821.928465:0:22670:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000040:01000000:2.0:1788869821.929719:0:23401:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1788869821.937687:0:22669:0:(import.c:65:import_set_state_nolock()) ffff8e282d8c9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869821.938275:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765325193344:12345-0@lo:38:llog_process_th.0 Request processed in 18095us (18600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869821.938296:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:3.0:1788869821.938474:0:23401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788869821.938831:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1788869821.938972:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1788869821.939368:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788869821.939381:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788869821.939392:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788869821.939399:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788869821.939403:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282d8ca000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788869821.939419:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325193344:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788869821.940448:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869821.940467:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325193728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869821.940865:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869821.945306:0:22670:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788869821.946215:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325193472 00000100:00100000:2.0:1788869821.946229:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325193472 00000100:00100000:2.0:1788869821.946264:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869821.946274:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875765325193472:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788869821.946431:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875765325193472:12345-0@lo:38:kworker.0 Request processed in 157us (23369us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788869821.946439:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869821.950164:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325193728 00000100:00100000:0.0:1788869821.950182:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325193728 00000100:00100000:0.0:1788869821.950251:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869821.950264:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875765325193728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788869821.950313:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788869821.950387:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875765325193728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (9522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869821.950395:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788869821.950445:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325193728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869821.951088:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788869821.951104:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e280a5b6800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788869821.951109:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788869821.951113:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325193472:0@lo:38:kworker.0 00000040:00080000:2.0:1788869821.951630:0:23406:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788869821.951636:0:23406:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788869821.956903:0:23401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788869821.956923:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788869821.956979:0:23401:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788869821.957162:0:23401:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6d0442 00000100:00080000:2.0:1788869821.957174:0:23401:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869821.957186:0:23401:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e282d8c8000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869821.957231:0:23401:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e270402d880 x1875765325193856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869821.957251:0:23401:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788869821.957317:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:3.0:1788869821.957318:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:2.0:1788869821.957321:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:3.0:1788869821.957323:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:2.0:1788869821.957323:0:23401:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000100:00080000:3.0:1788869821.957326:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:01000000:2.0:1788869821.957326:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00080000:3.0:1788869821.957328:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788869821.957329:0:23401:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1788869821.957330:0:23401:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788869821.957332:0:23401:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788869821.957333:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788869821.957336:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869821.957337:0:23401:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788869821.957352:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788869821.957357:0:23401:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788869821.957362:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869821.957363:0:23401:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788869821.957366:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788869821.957371:0:23401:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.154@tcp to nid 0x20000c0a8cc9a (192.168.204.154@tcp) 00000020:01000000:2.0:1788869821.957397:0:23401:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788869821.957400:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788869821.957415:0:23401:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8e2840a3cd40) 00000020:00000080:2.0:1788869821.957430:0:23401:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788869821.957435:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788869821.957508:0:23401:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788869821.957517:0:23401:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788869821.957523:0:23401:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4c16c38a9b6d0450 00010000:00080000:2.0:1788869821.957556:0:23401:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e27029d0800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.154@tcp at head 00000100:00100000:0.0:1788869821.957793:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325193856:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788869821.957853:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765325193856 offset 0 length 520: 4 00010000:00010000:2.0:1788869821.957938:0:23401:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788869821.958109:0:23401:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788869821.958127:0:23401:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788869821.960954:0:23401:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869821.962188:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788869821.962421:0:23401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1788869821.963233:0:23409:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788869821.963239:0:23409:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788869821.966835:0:23401:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788869821.966865:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788869821.966919:0:23401:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788869821.966944:0:23401:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6d0457 00000100:00080000:2.0:1788869821.966957:0:23401:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869821.966970:0:23401:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e27029d0800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869821.967286:0:23401:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e270402ce00 x1875765325193984/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869821.967334:0:23401:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788869821.967406:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869821.967412:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869821.967415:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869821.967418:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788869821.967419:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869821.967423:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869821.967424:0:23401:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788869821.967427:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869821.967431:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869821.967433:0:23401:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788869821.967436:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788869821.967438:0:23401:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788869821.967440:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869821.967442:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869821.967444:0:23401:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788869821.967446:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869821.967448:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869821.967449:0:23401:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788869821.967453:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788869821.967501:0:23401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869821.967505:0:23401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869821.967507:0:23401:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788869821.967510:0:23401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:3.0:1788869821.967611:0:23397:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788869821.967649:0:23397:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788869821.967668:0:23397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6d03d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d03e0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869821.967691:0:23397:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840eda800/0x4c16c38a9b6d03d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d03e0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869821.967699:0:23397:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2704079800 from 1 10000000:01000000:3.0:1788869821.967703:0:23397:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788869821.967730:0:23397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8800/0x4c16c38a9b6d045e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869821.967738:0:23397:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8800/0x4c16c38a9b6d045e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869821.967764:0:23397:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8800/0x4c16c38a9b6d045e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869821.967790:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325194112:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788869821.967865:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869821.967914:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27040b83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869821.967948:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325194112 00000100:00100000:1.0:1788869821.967957:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325194112 00000100:00100000:1.0:1788869821.968017:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788869821.968028:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+15:23397:x1875765325194112:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869821.968044:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1788869821.968045:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325193984:0@lo:8:llog_process_th.0 00010000:00010000:1.0:1788869821.968056:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6d0465 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d045e expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869821.968078:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6d0465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d045e expref: 16 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000400:00000100:0.0:1788869821.968084:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765325193984 offset 0 length 520: 4 00010000:00010000:1.0:1788869821.968089:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6d0465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d045e expref: 16 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869821.968119:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edaa00, rc 0) 00000100:00100000:1.0:1788869821.968168:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+16:23397:x1875765325194112:12345-0@lo:101:mount.lustre.0 Request processed in 141us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869821.968175:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788869821.968279:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325194112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869821.968294:0:23397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8800/0x4c16c38a9b6d045e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0465 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869821.968304:0:23397:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8800/0x4c16c38a9b6d045e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d0465 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869821.970909:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325194240:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788869821.970991:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869821.971047:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282a736d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869821.974379:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325194240 00000100:00100000:3.0:1788869821.974397:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325194240 00000100:00100000:3.0:1788869821.974503:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788869821.974517:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+16:23397:x1875765325194240:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788869821.974551:0:22657:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788869821.974584:0:22657:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788869821.974617:0:22657:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788869821.974790:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+16:23397:x1875765325194240:12345-0@lo:256:mount.lustre.0 Request processed in 275us (3797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869821.974799:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788869821.974836:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325194240:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788869821.976151:0:23397:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869821.976191:0:23397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8800/0x4c16c38a9b6d045e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0465 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869821.976205:0:23397:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8800/0x4c16c38a9b6d045e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0465 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869821.976279:0:23397:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2704079800 from 1 10000000:01000000:2.0:1788869821.976282:0:23397:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788869821.976327:0:23397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d046c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869821.976336:0:23397:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d046c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869821.976347:0:23397:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d046c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869821.976376:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325194368:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788869821.976448:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869821.976814:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282a736d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869821.977439:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325194368 00000100:00100000:0.0:1788869821.977453:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325194368 00000100:00100000:0.0:1788869821.977538:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788869821.977565:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+16:23397:x1875765325194368:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869821.977613:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869821.977633:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbb4600/0x4c16c38a9b6d0473 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d046c expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869821.977662:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb4600/0x4c16c38a9b6d0473 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d046c expref: 17 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869821.977684:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbb4600/0x4c16c38a9b6d0473 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d046c expref: 17 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869821.977694:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4600, rc 0) 00000100:00100000:0.0:1788869821.977778:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:23397:x1875765325194368:12345-0@lo:101:mount.lustre.0 Request processed in 217us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869821.977787:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788869821.981373:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325194368:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869821.981412:0:23397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d046c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0473 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869821.981426:0:23397:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d046c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d0473 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788869821.987634:0:23397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1788869821.990909:0:23397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869821.992493:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788869821.992927:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1788869821.992945:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1788869821.992963:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1788869821.993001:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1788869821.993019:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1788869821.993034:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1788869821.993049:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1788869821.993066:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788869821.993788:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1788869821.993815:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1788869821.993842:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1788869821.993847:0:23397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1788869821.993975:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325194496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869821.994060:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869821.994316:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e283c82b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788869821.994436:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325194496 00000100:00100000:3.0:1788869821.994444:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325194496 00000100:00100000:3.0:1788869821.994545:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788869821.994556:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:23397:x1875765325194496:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869821.994746:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:23397:x1875765325194496:12345-0@lo:501:mount.lustre.0 Request processed in 192us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869821.994754:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788869821.994853:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325194496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869821.994895:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325194624:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869821.994937:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869821.997262:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282a736900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869821.997912:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325194624 00000100:00100000:0.0:1788869821.997927:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325194624 00000100:00100000:0.0:1788869821.998001:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788869821.998012:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:23397:x1875765325194624:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869821.998815:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:23397:x1875765325194624:12345-0@lo:503:mount.lustre.0 Request processed in 799us (3871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869821.998825:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788869821.999039:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325194624:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788869821.999903:0:23397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788869821.999995:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325194752:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869822.000077:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869822.000207:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282a736900 going to sleep for 11 seconds 00000100:00100000:3.0:1788869822.000364:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325194752 00000100:00100000:3.0:1788869822.000373:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325194752 00000100:00100000:3.0:1788869822.000416:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788869822.000425:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:23397:x1875765325194752:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869822.000571:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:23397:x1875765325194752:12345-0@lo:502:mount.lustre.0 Request processed in 145us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869822.000579:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788869822.000898:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325194752:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869822.001263:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788869822.001302:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1788869822.001317:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1788869822.001330:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1788869822.001343:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1788869822.001357:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1788869822.001370:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1788869822.001382:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1788869822.001394:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788869822.001407:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1788869822.001420:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1788869822.001450:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325194880:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869822.001578:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869822.001630:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282a736900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869822.001738:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325194880 00000100:00100000:0.0:1788869822.001746:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325194880 00000100:00100000:0.0:1788869822.001782:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788869822.001790:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:23397:x1875765325194880:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869822.001912:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:23397:x1875765325194880:12345-0@lo:502:mount.lustre.0 Request processed in 122us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869822.001919:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788869822.002310:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325194880:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869822.002375:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1788869822.002389:0:23397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788869822.004164:0:23411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869822.004180:0:23411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.004183:0:23411:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788869822.004191:0:23411:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2704079800 00000020:00000080:3.0:1788869822.004194:0:23411:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788869822.004203:0:23411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869822.004206:0:23411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.004207:0:23411:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788869822.004209:0:23411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869822.004212:0:23411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.004213:0:23411:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788869822.004216:0:23411:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e2704079800 00000020:00000080:3.0:1788869822.004219:0:23411:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788869822.004293:0:23411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869822.004297:0:23411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.004298:0:23411:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788869822.004301:0:23411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869822.004303:0:23411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.004304:0:23411:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788869822.004308:0:23411:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2704079800 00000020:00000080:3.0:1788869822.004324:0:23411:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788869822.004345:0:23411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869822.004348:0:23411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.004349:0:23411:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788869822.004351:0:23411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869822.004354:0:23411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.004356:0:23411:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788869822.004359:0:23411:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e2704079800 00000020:00000080:3.0:1788869822.004361:0:23411:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788869822.004383:0:23411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869822.004386:0:23411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869822.004387:0:23411:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788869822.004390:0:23411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1788869822.006500:0:23397:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788869822.006554:0:23397:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788869822.006577:0:23397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d046c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0473 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869822.006608:0:23397:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d046c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0473 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869822.006666:0:23397:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788869822.006669:0:23397:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e2704079800 10000000:01000000:0.0:1788869822.006775:0:23397:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e2704079800 10000000:01000000:0.0:1788869822.006781:0:23397:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788869822.006796:0:23397:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e2704079800 from 1 10000000:01000000:0.0:1788869822.006799:0:23397:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788869822.006838:0:23397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6d047a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869822.006847:0:23397:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6d047a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869822.006859:0:23397:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6d047a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869822.006886:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325195008:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788869822.006957:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869822.007002:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325195008 00000100:00100000:0.0:1788869822.007010:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325195008 00000100:00100000:0.0:1788869822.007057:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788869822.007065:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:23397:x1875765325195008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869822.007261:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869822.007275:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbb5000/0x4c16c38a9b6d0481 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d047a expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869822.007299:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb5000/0x4c16c38a9b6d0481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d047a expref: 18 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869822.007311:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbb5000/0x4c16c38a9b6d0481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d047a expref: 18 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869822.007320:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5000, rc 0) 00000100:00100000:0.0:1788869822.007355:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:23397:x1875765325195008:12345-0@lo:101:mount.lustre.0 Request processed in 290us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869822.007376:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788869822.007433:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2809294540 going to sleep for 11 seconds 00000100:00100000:0.0:1788869822.007457:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325195008:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788869822.007487:0:23397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6d047a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0481 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869822.007765:0:23397:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6d047a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d0481 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788869822.012911:0:23397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:1.0:1788869822.013290:0:23397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788869822.013650:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:1.0:1788869822.013747:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:1.0:1788869822.013767:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:1.0:1788869822.013782:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:1.0:1788869822.013797:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:1.0:1788869822.013810:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:1.0:1788869822.013824:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:1.0:1788869822.013836:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:1.0:1788869822.013862:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:1.0:1788869822.013874:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:1.0:1788869822.013885:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:1.0:1788869822.013897:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:1.0:1788869822.013907:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:1.0:1788869822.013917:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:1.0:1788869822.013939:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:1.0:1788869822.013948:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:1.0:1788869822.013959:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:1.0:1788869822.013969:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:1.0:1788869822.013979:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:1.0:1788869822.013989:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:1.0:1788869822.013999:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:1.0:1788869822.014009:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:1.0:1788869822.014021:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:1.0:1788869822.014032:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:1.0:1788869822.014056:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:1.0:1788869822.014070:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:1.0:1788869822.015941:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:1.0:1788869822.015965:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:1.0:1788869822.015981:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:1.0:1788869822.015995:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:1.0:1788869822.016010:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:1.0:1788869822.016026:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:1.0:1788869822.016043:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:1.0:1788869822.016056:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:1.0:1788869822.016070:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:1.0:1788869822.016198:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:1.0:1788869822.016214:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:1.0:1788869822.016228:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:1.0:1788869822.016241:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:1.0:1788869822.016255:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:1.0:1788869822.016299:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:1.0:1788869822.016317:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:1.0:1788869822.016332:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:1.0:1788869822.016347:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:1.0:1788869822.016361:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:1.0:1788869822.016376:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:1.0:1788869822.016390:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:1.0:1788869822.016419:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:1.0:1788869822.018199:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:1.0:1788869822.018263:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:1.0:1788869822.018294:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:1.0:1788869822.018300:0:23397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:1.0:1788869822.018430:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325195136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869822.018521:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869822.018606:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325195136 00000100:00100000:1.0:1788869822.018617:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325195136 00000100:00100000:1.0:1788869822.020257:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788869822.020280:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:23397:x1875765325195136:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869822.022277:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:23397:x1875765325195136:12345-0@lo:501:mount.lustre.0 Request processed in 197us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869822.022293:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788869822.022357:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00000100:00100000:1.0:1788869822.023875:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280833d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869822.023919:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325195136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869822.023988:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325195264:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869822.024068:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869822.032881:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280833d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869822.032967:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325195264 00000100:00100000:0.0:1788869822.032979:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325195264 00000100:00100000:0.0:1788869822.033047:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788869822.033056:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:23397:x1875765325195264:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869822.033234:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:23397:x1875765325195264:12345-0@lo:503:mount.lustre.0 Request processed in 179us (9166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869822.033242:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788869822.036978:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325195264:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788869822.037542:0:23397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788869822.037856:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325195392:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869822.037926:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869822.042860:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869822.043781:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325195392 00000100:00100000:1.0:1788869822.043794:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325195392 00000100:00100000:1.0:1788869822.043862:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788869822.043873:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:23397:x1875765325195392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869822.044897:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:23397:x1875765325195392:12345-0@lo:502:mount.lustre.0 Request processed in 1021us (6965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869822.044910:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788869822.051556:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325195392:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788869822.051927:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1788869822.051962:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1788869822.051977:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1788869822.051989:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1788869822.052001:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1788869822.052013:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1788869822.052024:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1788869822.052036:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1788869822.052068:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1788869822.052084:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1788869822.052204:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1788869822.052224:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1788869822.052237:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1788869822.052249:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1788869822.052261:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1788869822.052273:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1788869822.052287:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1788869822.052300:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1788869822.052324:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1788869822.052338:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1788869822.052353:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1788869822.052364:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1788869822.052375:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1788869822.052386:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1788869822.052411:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1788869822.052426:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1788869822.052439:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1788869822.052452:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1788869822.052462:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1788869822.054669:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1788869822.054975:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1788869822.054997:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1788869822.055013:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1788869822.055026:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1788869822.055041:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1788869822.055053:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1788869822.055064:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1788869822.055076:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1788869822.055089:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1788869822.055577:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1788869822.055631:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1788869822.055648:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1788869822.055661:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1788869822.055676:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1788869822.055690:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1788869822.055703:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1788869822.055715:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1788869822.055838:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1788869822.055913:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325195520:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869822.056001:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869822.056065:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325195520 00000100:00100000:3.0:1788869822.056074:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325195520 00000100:00100000:3.0:1788869822.056139:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788869822.056150:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:23397:x1875765325195520:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869822.056292:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:23397:x1875765325195520:12345-0@lo:502:mount.lustre.0 Request processed in 144us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869822.056300:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788869822.056357:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27040b8000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869822.056380:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325195520:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869822.057913:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1788869822.057977:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1788869822.058036:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325195648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869822.058636:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869822.058753:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a8300 going to sleep for 11 seconds 00000100:00100000:0.0:1788869822.059633:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325195648 00000100:00100000:0.0:1788869822.059644:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325195648 00000100:00100000:0.0:1788869822.060275:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788869822.060287:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:23397:x1875765325195648:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869822.060443:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:23397:x1875765325195648:12345-0@lo:502:mount.lustre.0 Request processed in 158us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869822.060451:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788869822.060735:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325195648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869822.060839:0:23397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1788869822.060855:0:23397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788869822.062869:0:23416:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788869822.062894:0:23416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8e2840a3b380) 00000020:00000080:2.0:1788869822.062922:0:23416:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788869822.063025:0:23416:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e2704079800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788869822.063029:0:23416:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e2704079800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788869822.063031:0:23416:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e2704079800 3 00010000:00080000:2.0:1788869822.063225:0:23416:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2803f18800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788869822.067922:0:23416:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788869822.068583:0:23416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788869822.068655:0:23416:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788869822.068672:0:23416:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x4c16c38a9b6d048f 00000100:00080000:2.0:1788869822.068686:0:23416:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869822.068701:0:23416:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8e2803f18800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869822.069248:0:23416:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e270402c000 x1875765325195776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869822.069291:0:23416:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788869822.069311:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765325195776:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788869822.069400:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788869822.069615:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869822.069621:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869822.069624:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869822.069628:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788869822.070204:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325195776 00000100:00100000:2.0:1788869822.070215:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325195776 00000100:00100000:2.0:1788869822.070252:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788869822.070260:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875765325195776:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788869822.070285:0:22665:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 755 last 0 00000020:00000080:2.0:1788869822.070318:0:22665:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4c16c38a9b6d0496 00000004:00100000:2.0:1788869822.070334:0:22665:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788869822.070368:0:22665:0:(import.c:65:import_set_state_nolock()) ffff8e2701f1d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869822.070435:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875765325195776:12345-0@lo:38:llog_process_th.0 Request processed in 174us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869822.070449:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788869822.071973:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e270402c000 x1875765325195776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869822.071990:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788869822.072002:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788869822.072012:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788869822.072018:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788869822.072020:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2803f18800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788869822.072028:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875765325195776:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788869822.072426:0:23416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1788869822.072612:0:23397:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788869822.072662:0:23397:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788869822.072689:0:23397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6d047a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0481 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869822.072703:0:23397:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e282dbb4a00/0x4c16c38a9b6d047a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0481 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788869822.072763:0:23397:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788869822.072766:0:23397:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788869822.072768:0:23397:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869822.072769:0:23397:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869822.072770:0:23397:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869822.072772:0:23397:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869822.072773:0:23397:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869822.072775:0:23397:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869822.072776:0:23397:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788869822.072780:0:23397:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788869822.072783:0:23397:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788869822.072784:0:23397:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788869822.072790:0:23397:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869822.072791:0:23397:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869822.072792:0:23397:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869822.072793:0:23397:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869822.072794:0:23397:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869822.072794:0:23397:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869822.072796:0:23397:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788869822.072819:0:23397:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788869822.072840:0:23397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325195904:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788869822.072914:0:23397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869822.072948:0:23397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0a8840 going to sleep for 11 seconds 00000100:00100000:3.0:1788869822.073239:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325195904 00000100:00100000:3.0:1788869822.073247:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325195904 00000100:00100000:3.0:1788869822.073349:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788869822.073360:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:23397:x1875765325195904:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788869822.073388:0:22657:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788869822.073403:0:22657:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788869822.075413:0:22644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788869822.087300:0:22657:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788869822.087365:0:22657:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788869822.089557:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:23397:x1875765325195904:12345-0@lo:253:mount.lustre.0 Request processed in 16188us (16631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869822.089577:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788869822.089709:0:23397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:23397:1875765325195904:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788869822.089740:0:23397:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788869822.089744:0:23397:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788869822.089746:0:23397:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788869822.089748:0:23397:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869822.089749:0:23397:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869822.089750:0:23397:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869822.089751:0:23397:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869822.089752:0:23397:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788869822.089754:0:23397:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869822.089756:0:23397:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788869822.089774:0:23397:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:2.0:1788869822.094638:0:23397:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788869822.094751:0:23422:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788869822.094755:0:23422:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 20000000:01000000:3.0:1788869822.095973:0:22680:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788869822.095983:0:22680:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788869822.096010:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d049d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.096032:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d03a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d039a expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.096048:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6d0465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d045e expref: 17 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.096056:0:22680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d049d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.096124:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6d0465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6d045e expref: 17 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.096144:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6d0465 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6d045e expref: 17 pid: 22658 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869822.096163:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875765325196032:0@lo:104: 00000100:00100000:3.0:1788869822.096248:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869822.096302:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d03a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6d039a expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.096311:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d03a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6d039a expref: 17 pid: 22657 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869822.096319:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875765325196160:0@lo:104: 00000100:00100000:3.0:1788869822.096342:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869822.096360:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27040b8000 going to sleep for 11 seconds 00000100:00100000:3.0:1788869822.096410:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325196032 00000100:00100000:3.0:1788869822.096421:0:22648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325196032 00000100:00100000:3.0:1788869822.096459:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325196160 00000100:00100000:3.0:1788869822.096462:0:22648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325196160 00000100:00100000:3.0:1788869822.096476:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869822.096487:0:22648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+4:22680:x1875765325196032:12345-0@lo:104: 00010000:00010000:3.0:1788869822.096518:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8800/0x4c16c38a9b6d045e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d0465 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.096574:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788869822.096581:0:22648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+4:22680:x1875765325196032:12345-0@lo:104: Request processed in 96us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869822.096617:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869822.096639:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869822.096646:0:22648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+3:22680:x1875765325196160:12345-0@lo:104: 00010000:00010000:3.0:1788869822.096653:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d039a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d03a1 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.096698:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788869822.096703:0:22648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+3:22680:x1875765325196160:12345-0@lo:104: Request processed in 59us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869822.096709:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869822.096747:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875765325196032:0@lo:104: 00000100:00100000:3.0:1788869822.096755:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875765325196160:0@lo:104: 00010000:00010000:3.0:1788869822.096774:0:22680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d049d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.096790:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869822.096795:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8800/0x4c16c38a9b6d045e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d0465 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.096802:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8800 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869822.096806:0:22652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8800/0x4c16c38a9b6d045e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6d0465 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.096821:0:22652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8800/0x4c16c38a9b6d045e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6d0465 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869822.096828:0:22652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8800/0x4c16c38a9b6d045e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6d0465 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869822.096833:0:22652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869822.096860:0:22652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8800/0x4c16c38a9b6d045e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d0465 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.096865:0:22652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869822.096884:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8800/0x4c16c38a9b6d045e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d0465 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.096891:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8800/0x4c16c38a9b6d045e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d0465 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.096902:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869822.096905:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d039a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d03a1 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.096910:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5c00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:3.0:1788869822.096914:0:22652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d039a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6d03a1 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.096919:0:22652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d039a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6d03a1 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788869822.096926:0:22652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d039a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6d03a1 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869822.096941:0:22652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788869822.096955:0:22652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d039a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d03a1 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.096961:0:22652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788869822.096967:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d039a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d03a1 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.096974:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d039a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d03a1 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.096987:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869822.096988:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869822.096990:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869822.097011:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869822.097031:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325196288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869822.097063:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869822.097084:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869822.097089:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325196416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869822.097121:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869822.097158:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325196288 00000100:00100000:3.0:1788869822.097162:0:22649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325196288 00010000:00010000:3.0:1788869822.097181:0:22649:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6d0465 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d045e expref: 18 pid: 22658 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869822.097204:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325196416 00000100:00100000:3.0:1788869822.097207:0:22649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325196416 00010000:00010000:3.0:1788869822.097217:0:22649:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d03a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d039a expref: 19 pid: 22657 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869822.097243:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869822.097250:0:22649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+19:3650:x1875765325196288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869822.097264:0:22649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869822.097270:0:22649:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6d0465 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d045e expref: 19 pid: 22658 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.097282:0:22649:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6d0465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6d045e expref: 19 pid: 22658 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.097298:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edaa00/0x4c16c38a9b6d0465 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6d045e expref: 19 pid: 22658 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.097311:0:22649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869822.097340:0:22649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:3650:x1875765325196288:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869822.097348:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869822.097360:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869822.097367:0:22649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:3650:x1875765325196416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788869822.097374:0:22649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869822.097378:0:22649:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d03a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d039a expref: 17 pid: 22657 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.097387:0:22649:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d03a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6d039a expref: 17 pid: 22657 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.097396:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2842042600/0x4c16c38a9b6d03a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6d039a expref: 17 pid: 22657 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.097419:0:22649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d049d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.097427:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d049d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788869822.097443:0:22649:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010361026s 00010000:00010000:3.0:1788869822.097448:0:22649:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d049d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.097455:0:22649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d049d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.097463:0:22649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d049d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.097470:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d049d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.097476:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed8200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869822.097480:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d049d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.097487:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d049d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.097500:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d049d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.097508:0:22649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869822.097535:0:22649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+16:3650:x1875765325196416:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869822.097543:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788869822.097675:0:22680:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d049d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.097684:0:22680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d049d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869822.097689:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d049d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869822.097716:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325196416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788869822.097724:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325196288:0@lo:103:ldlm_bl.0 00000040:01000000:1.0:1788869822.103914:0:23423:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1788869822.108301:0:23423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869822.115573:0:23423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000040:01000000:1.0:1788869822.115787:0:23397:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:01000000:1.0:1788869822.117339:0:23397:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788869822.117389:0:23397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788869822.117848:0:23424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23424:1875765325196544:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788869822.117923:0:23424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869822.117974:0:23424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27040b8000 going to sleep for 11 seconds 00000004:00000080:1.0:1788869822.118400:0:23397:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788869822.118413:0:23397:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788869822.118480:0:23397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788869822.118892:0:23423:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1788869822.119945:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325196544 00000100:00100000:2.0:1788869822.119958:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325196544 00000100:00100000:2.0:1788869822.120028:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869822.120052:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23424:x1875765325196544:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788869822.120203:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23424:x1875765325196544:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 154us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869822.120210:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788869822.120364:0:23424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23424:1875765325196544:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788869822.120403:0:23424:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788869822.120449:0:23424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23424:1875765325196672:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788869822.120493:0:23424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869822.120521:0:23424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27040b8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788869822.120629:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325196672 00000100:00100000:0.0:1788869822.120634:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325196672 00000100:00100000:0.0:1788869822.120667:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788869822.120976:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23424:x1875765325196672:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788869822.123101:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23424:x1875765325196672:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 2109us (2587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869822.123116:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788869822.123910:0:23424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23424:1875765325196672:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788869822.124004:0:23424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23424:1875765325196800:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788869822.124054:0:23424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869822.124102:0:23424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27040b8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788869822.125315:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325196800 00000100:00100000:2.0:1788869822.125328:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325196800 00000100:00100000:2.0:1788869822.125381:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788869822.125392:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23424:x1875765325196800:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788869822.125503:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23424:x1875765325196800:12345-0@lo:900:lod0001_rec0000.0 Request processed in 112us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869822.125511:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1788869822.126215:0:23397:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788869822.126792:0:23397:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788869822.126839:0:23397:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788869822.130985:0:23397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788869822.131729:0:23397:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00010000:00080000:2.0:1788869822.132468:0:23424:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e280138ca80 x1875765325196800/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788869838 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869822.132491:0:23424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138ca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23424:1875765325196800:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788869822.132626:0:23424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23424:1875765325196928:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788869822.132720:0:23424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869822.132768:0:23424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2806d459c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869822.133250:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325196928 00000100:00100000:1.0:1788869822.133262:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325196928 00000100:00100000:1.0:1788869822.133539:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788869822.133551:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23424:x1875765325196928:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788869822.133730:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23424:x1875765325196928:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 182us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869822.133739:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869822.133819:0:23424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23424:1875765325196928:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788869822.133884:0:23424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869822.135939:0:23424:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788869822.136111:0:23424:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788869822.136118:0:23424:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1788869822.142367:0:23397:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1788869822.147132:0:23397:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788869822.147188:0:23397:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb9f680dab988 00100000:10000000:2.0:1788869822.147198:0:23397:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788869822.148106:0:23397:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788869822.148156:0:23397:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788869822.148180:0:23397:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788869822.148218:0:23397:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788869822.157524:0:23397:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788869822.160818:0:23397:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788869822.409413:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869823.045816:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00000040:00080000:2.0:1788869823.112973:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788869823.432150:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788869823.627789:0:22661:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788869823.627800:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2704079800 from 12 10000000:01000000:2.0:1788869823.627831:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788869823.627898:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6d04a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869823.627913:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6d04a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869823.627928:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6d04a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869823.627960:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325197056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869823.628047:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869823.628130:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840f55180 going to sleep for 11 seconds 00000100:00100000:1.0:1788869823.630754:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325197056 00000100:00100000:1.0:1788869823.630780:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325197056 00000100:00100000:1.0:1788869823.630878:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788869823.630893:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+16:22661:x1875765325197056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869823.630910:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869823.630932:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edbc00/0x4c16c38a9b6d04ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d04a4 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869823.630966:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edbc00/0x4c16c38a9b6d04ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d04a4 expref: 17 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869823.631009:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edbc00/0x4c16c38a9b6d04ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d04a4 expref: 17 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869823.631020:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edbc00, rc 0) 00000100:00100000:1.0:1788869823.631382:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:22661:x1875765325197056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 491us (3332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869823.631390:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788869823.631620:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325197056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869823.631650:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6d04a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d04ab expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869823.631661:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6d04a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d04ab expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869823.631734:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325197184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788869823.631777:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869823.631819:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840f55180 going to sleep for 11 seconds 00000100:00100000:0.0:1788869823.631870:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325197184 00000100:00100000:0.0:1788869823.631875:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325197184 00000100:00100000:0.0:1788869823.631903:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788869823.631910:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:22661:x1875765325197184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788869823.631924:0:22657:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788869823.631939:0:22657:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788869823.631942:0:22657:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788869823.632021:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:22661:x1875765325197184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869823.632028:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788869823.632162:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325197184:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788869823.632206:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869823.632213:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6d04a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d04ab expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869823.632230:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6d04a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d04ab expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869823.632241:0:22661:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788869823.632243:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e283b011000 from 12 10000000:01000000:2.0:1788869823.632246:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788869823.632267:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6d04b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869823.632274:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6d04b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869823.632282:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6d04b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869823.632293:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325197312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869823.632318:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869823.632341:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840f55180 going to sleep for 11 seconds 00000100:00100000:0.0:1788869823.632440:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325197312 00000100:00100000:0.0:1788869823.632444:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325197312 00000100:00100000:0.0:1788869823.632475:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788869823.632482:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:22661:x1875765325197312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869823.632496:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869823.632507:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6d04b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d04b2 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869823.632524:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6d04b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d04b2 expref: 18 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869823.632533:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6d04b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d04b2 expref: 18 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869823.632541:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb5400, rc 0) 00000100:00100000:0.0:1788869823.632570:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:22661:x1875765325197312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869823.632576:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788869823.633034:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325197312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869823.633047:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6d04b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d04b9 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869823.633065:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6d04b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d04b9 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869823.633120:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325197440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788869823.633160:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869823.633189:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840f55180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869823.633205:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325197440 00000100:00100000:2.0:1788869823.633209:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325197440 00000100:00100000:2.0:1788869823.633230:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788869823.633236:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:22661:x1875765325197440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788869823.633249:0:22657:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788869823.633262:0:22657:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788869823.633265:0:22657:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788869823.633335:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:22661:x1875765325197440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 99us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869823.633342:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788869823.633372:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325197440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788869823.633406:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788869823.633412:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6d04b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d04b9 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869823.633419:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6d04b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d04b9 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869824.069946:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00000040:00080000:2.0:1788869824.136456:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788869824.453807:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869825.093650:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00010000:00010000:2.0:1788869825.478879:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869826.136843:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00010000:00010000:3.0:1788869826.505203:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788869827.078232:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788869827.153461:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 0 seconds 00000100:00080000:3.0:1788869827.397718:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788869827.397726:0:23440:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788869827.397730:0:23440:0:(import.c:65:import_set_state_nolock()) ffff8e280a5b6800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869827.397748:0:23440:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8e280a5b6800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869827.397772:0:23440:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e280138ea00 x1875765325197696/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869827.397789:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869827.397793:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869827.397796:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869827.397799:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869827.397822:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869827.397826:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869827.397828:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869827.397831:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788869827.397880:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325197824:0@lo:400:kworker.0 00000100:00100000:3.0:1788869827.397955:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869827.398035:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869827.398042:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3649:1875765325197568:0@lo:400:kworker.0 00000100:00100000:3.0:1788869827.398076:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869827.398111:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325197696:0@lo:38:kworker.0 00000100:00100000:3.0:1788869827.398144:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869827.398174:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325197952:0@lo:400:kworker.0 00000100:00100000:3.0:1788869827.398198:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869827.398216:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869827.398221:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325198080:0@lo:400:kworker.0 00000100:00100000:3.0:1788869827.398241:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869827.398275:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325197824 00000100:00100000:3.0:1788869827.398282:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325197824 00000100:00100000:3.0:1788869827.398324:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325198080 00000100:00100000:3.0:1788869827.398327:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325198080 00000100:00100000:3.0:1788869827.398344:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869827.398352:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325197824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869827.398402:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325197824:12345-0@lo:400:kworker.0 Request processed in 50us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869827.398409:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869827.398426:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788869827.398432:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325198080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869827.398463:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325198080:12345-0@lo:400:kworker.0 Request processed in 31us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869827.398468:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788869827.398487:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325197568 00000100:00100000:3.0:1788869827.398490:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325197568 00000100:00100000:3.0:1788869827.398519:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788869827.398536:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:3649:x1875765325197568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869827.398567:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:3649:x1875765325197568:12345-0@lo:400:kworker.0 Request processed in 33us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869827.398573:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788869827.398631:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325197696 00000100:00100000:3.0:1788869827.398635:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325197696 00000100:00100000:3.0:1788869827.398650:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325197952 00000100:00100000:3.0:1788869827.398652:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325197952 00000100:00100000:3.0:1788869827.398666:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869827.398670:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875765325197696:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788869827.398695:0:22670:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 761 last 0 00000020:00000080:3.0:1788869827.398732:0:22670:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6d04c0 00000004:00100000:3.0:1788869827.398748:0:22670:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788869827.398754:0:22670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1788869827.398832:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869827.398840:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325197952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869827.398873:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325197952:12345-0@lo:400:kworker.0 Request processed in 34us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869827.398878:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788869827.398924:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e280138fb80 x1875765325198080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869827.398938:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325198080:0@lo:400:kworker.0 00000100:00100000:3.0:1788869827.398950:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325197952:0@lo:400:kworker.0 00000100:00100000:3.0:1788869827.398990:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3649:1875765325197568:0@lo:400:kworker.0 00010000:00080000:3.0:1788869827.399000:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e280138d180 x1875765325197824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869827.399014:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325197824:0@lo:400:kworker.0 00000100:00100000:1.0:1788869827.401111:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869827.401133:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325198208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869827.401206:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869827.401252:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325198208 00000100:00100000:1.0:1788869827.401260:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325198208 00000100:00100000:1.0:1788869827.401309:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869827.401318:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325198208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869827.401357:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788869827.401408:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325198208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869827.401415:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869827.401462:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325198208:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788869827.419148:0:22670:0:(import.c:65:import_set_state_nolock()) ffff8e270407a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869827.419257:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765325197696:12345-0@lo:38:kworker.0 Request processed in 20582us (21109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869827.419271:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788869827.419705:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788869827.419718:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788869827.419725:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788869827.419727:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e280a5b6800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788869827.419746:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ce3def6e): req@ffff8e270402f800 x1875765325190400/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869827.419766:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325197696:0@lo:38:kworker.0 00000100:00100000:0.0:1788869827.419866:0:22706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869827.419892:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802d25180 going to sleep for 11 seconds 00000100:00100000:0.0:1788869827.419908:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325190400 00000100:00100000:0.0:1788869827.419915:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325190400 00000100:00100000:0.0:1788869827.419952:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788869827.420303:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22706:x1875765325190400:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788869827.420384:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22706:x1875765325190400:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 83us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869827.420391:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788869827.420424:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402f800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22706:1875765325190400:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788869827.420458:0:22706:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788869827.420504:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22706:1875765325198336:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788869827.420534:0:22706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869827.420559:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e393c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869827.422358:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869827.422381:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325198464:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869827.422456:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869827.422499:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325198336 00000100:00100000:3.0:1788869827.422506:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325198336 00000100:00100000:3.0:1788869827.422541:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325198464 00000100:00100000:3.0:1788869827.422543:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325198464 00000100:00100000:3.0:1788869827.422557:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788869827.422564:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22706:x1875765325198336:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788869827.422731:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22706:x1875765325198336:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 167us (2197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869827.422739:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788869827.422755:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869827.422760:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875765325198464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788869827.422781:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788869827.422814:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875765325198464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869827.422820:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869827.422858:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22706:1875765325198336:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788869827.423134:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22706:1875765325198592:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788869827.423169:0:22706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869827.423920:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28131a4540 going to sleep for 11 seconds 00000100:00100000:3.0:1788869827.423982:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325198464:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869827.424324:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325198592 00000100:00100000:1.0:1788869827.424333:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325198592 00000100:00100000:1.0:1788869827.424387:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788869827.424395:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22706:x1875765325198592:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788869827.424851:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22706:x1875765325198592:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 454us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869827.424874:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788869827.425784:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22706:1875765325198592:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788869827.425847:0:22706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869827.431234:0:22706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788869827.431320:0:22706:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 22, retries 0 00000004:00080000:2.0:1788869827.431326:0:22706:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788869827.528453:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788869827.650612:0:23668:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788869828.554397:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788869829.032726:0:23720:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869829.032943:0:23720:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788869829.578624:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788869830.036942:0:23771:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869830.037283:0:23771:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788869830.470009:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869815/real 1788869815] req@ffff8e280138f100 x1875765325191424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869830 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869830.470050:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e280138f100 x1875765325191424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869830 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869830.470061:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869815/real 1788869815] req@ffff8e280138f800 x1875765325191552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869830 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869830.470072:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e280138f800 x1875765325191552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869830 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788869830.470095:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2703a18000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869830.470120:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788869830.470124:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325191424:0@lo:8:kworker.0 00000100:00080000:0.0:1788869830.470130:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2829c0c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869830.470135:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788869830.470137:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325191552:0@lo:8:kworker.0 00000100:00080000:3.0:1788869830.470327:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869830.470332:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788869830.470335:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e2703a18000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869830.470339:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 749 00000100:00080000:3.0:1788869830.470345:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788869830.470359:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e2703a18000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869830.470385:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2827a5ca80 x1875765325198976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869830.470411:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869830.470415:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788869830.470416:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e2829c0c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788869830.470420:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 749 00000100:00080000:3.0:1788869830.470422:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788869830.470427:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e2829c0c000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:3.0:1788869830.470438:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2827a5fb80 x1875765325199104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788869830.470489:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788869830.470494:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788869830.470499:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1788869830.470499:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325198976:0@lo:8:kworker.0 00000100:00100000:1.0:1788869830.470502:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325198848:0@lo:400:kworker.0 00000100:00080000:3.0:1788869830.470504:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788869830.470604:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325198720:0@lo:400:kworker.0 00000100:00100000:3.0:1788869830.470643:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325199232:0@lo:400:kworker.0 00000100:00100000:1.0:1788869830.473159:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869830.473266:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325199360:0@lo:400:kworker.0 00000100:00100000:1.0:1788869830.473308:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869830.473342:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325198848 00000100:00100000:1.0:1788869830.473350:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325198848 00000100:00100000:1.0:1788869830.473396:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325199360 00000100:00100000:1.0:1788869830.473399:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325199360 00000100:00100000:1.0:1788869830.473415:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869830.473423:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875765325198848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869830.474344:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875765325198848:12345-0@lo:400:kworker.0 Request processed in 915us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869830.474355:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869830.474381:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788869830.474389:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325199360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869830.474431:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325199360:12345-0@lo:400:kworker.0 Request processed in 44us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869830.474437:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000400:00000100:2.0:1788869830.475328:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765325198976 offset 0 length 520: 4 00000100:00100000:2.0:1788869830.475376:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325199104:0@lo:8:kworker.0 00000400:00000100:2.0:1788869830.475409:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765325199104 offset 0 length 520: 4 00000100:00100000:1.0:1788869830.475634:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325199360:0@lo:400:kworker.0 00000100:00100000:1.0:1788869830.475669:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325198848:0@lo:400:kworker.0 00000100:00100000:0.0:1788869830.475876:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869830.475917:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325199488:0@lo:400:kworker.0 00000100:00100000:1.0:1788869830.475919:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325198720 00000100:00100000:1.0:1788869830.475928:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325198720 00000100:00100000:0.0:1788869830.475956:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869830.475977:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788869830.475987:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:3650:x1875765325198720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869830.476095:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325199488 00000100:00100000:0.0:1788869830.476101:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325199488 00000100:00100000:0.0:1788869830.476550:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869830.476561:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325199488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869830.476753:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:3650:x1875765325198720:12345-0@lo:400:kworker.0 Request processed in 766us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869830.476760:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869830.476767:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788869830.476813:0:22665:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788869830.476823:0:22665:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788869830.476841:0:22664:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788869830.476849:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325199232 00000100:00100000:3.0:1788869830.476853:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325199232 00000100:00100000:3.0:1788869830.476870:0:22664:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788869830.476876:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869830.476892:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325199232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869830.476931:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325199232:12345-0@lo:400:kworker.0 Request processed in 48us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869830.476936:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788869830.477079:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2827a5d880 x1875765325199232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869830.477094:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325199232:0@lo:400:kworker.0 00000100:00100000:1.0:1788869830.477652:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325198720:0@lo:400:kworker.0 00000100:00100000:0.0:1788869830.478244:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325199488:12345-0@lo:400:kworker.0 Request processed in 1683us (2285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869830.478254:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788869830.478412:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e2827a5d500 x1875765325199488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869830.478426:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325199488:0@lo:400:kworker.0 00010000:00010000:3.0:1788869830.602773:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788869831.209219:0:23820:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff422f66f0 20000000:00000080:3.0:1788869831.209239:0:23820:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e2841e56c00 uarg=0000000000000000 20000000:01000000:3.0:1788869831.209291:0:23820:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788869831.209299:0:23820:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788869831.209304:0:23820:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788869831.210201:0:23821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788869831.210368:0:23820:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788869831.216399:0:23820:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788869831.216436:0:23820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d04c7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869831.216573:0:23820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840eda400/0x4c16c38a9b6d0370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d0369 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869831.216581:0:23820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e282dbb4600/0x4c16c38a9b6d0473 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d046c expref: 17 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869831.216720:0:23820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d04c7 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869831.216770:0:23820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e282dbb4600/0x4c16c38a9b6d0473 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6d046c expref: 17 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869831.216810:0:23820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e282dbb4600/0x4c16c38a9b6d0473 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6d046c expref: 17 pid: 22659 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869831.216826:0:23820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23820:1875765325199616:0@lo:104: 00000100:00100000:1.0:1788869831.216913:0:23820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788869831.216974:0:23820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840eda400/0x4c16c38a9b6d0370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6d0369 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869831.216982:0:23820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840eda400/0x4c16c38a9b6d0370 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6d0369 expref: 17 pid: 22657 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869831.216989:0:23820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23820:1875765325199744:0@lo:104: 00000100:00100000:1.0:1788869831.217009:0:23820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869831.217092:0:23820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e283c82b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869831.217406:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325199616 00000100:00100000:2.0:1788869831.217415:0:22648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325199616 00000100:00100000:2.0:1788869831.217468:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325199744 00000100:00100000:2.0:1788869831.217471:0:22648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325199744 00000100:00100000:2.0:1788869831.217486:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869831.217494:0:22648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+4:23820:x1875765325199616:12345-0@lo:104: 00010000:00010000:2.0:1788869831.217509:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d046c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d0473 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.217672:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788869831.217679:0:22648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+4:23820:x1875765325199616:12345-0@lo:104: Request processed in 185us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869831.217685:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869831.217701:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869831.217707:0:22648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+3:23820:x1875765325199744:12345-0@lo:104: 00010000:00010000:2.0:1788869831.217714:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d0369 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d0370 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.217748:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788869831.217754:0:22648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+3:23820:x1875765325199744:12345-0@lo:104: Request processed in 48us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869831.217760:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788869831.217775:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869831.217781:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d046c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d0473 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.217798:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842042200 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869831.217803:0:22653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d046c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6d0473 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.217811:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d046c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6d0473 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869831.217817:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d046c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6d0473 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869831.217823:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788869831.217851:0:22653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d046c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d0473 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.217858:0:22653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869831.217893:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d046c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d0473 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.217900:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d046c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d0473 expref: -99 pid: 23397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.217914:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869831.217917:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d0369 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d0370 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.217923:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842043400 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869831.217926:0:22653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d0369 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6d0370 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.217944:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d0369 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6d0370 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869831.217951:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d0369 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6d0370 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869831.217957:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788869831.217970:0:22653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d0369 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d0370 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.217977:0:22653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869831.217994:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d0369 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d0370 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.218002:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d0369 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d0370 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.218016:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869831.218018:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869831.218020:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869831.218026:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869831.218044:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3651:1875765325199872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869831.218076:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869831.218120:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3648:1875765325200000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869831.218142:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869831.218183:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325199872 00000100:00100000:2.0:1788869831.218187:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325199872 00010000:00010000:2.0:1788869831.218203:0:22650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e282dbb4600/0x4c16c38a9b6d0473 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d046c expref: 18 pid: 22659 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869831.218231:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325200000 00000100:00100000:2.0:1788869831.218234:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325200000 00010000:00010000:2.0:1788869831.218245:0:22650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840eda400/0x4c16c38a9b6d0370 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d0369 expref: 19 pid: 22657 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869831.218257:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869831.218264:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+19:3651:x1875765325199872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869831.218274:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869831.218279:0:22650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e282dbb4600/0x4c16c38a9b6d0473 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d046c expref: 19 pid: 22659 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.218289:0:22650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e282dbb4600/0x4c16c38a9b6d0473 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6d046c expref: 19 pid: 22659 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.218304:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869831.218331:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+19:3651:x1875765325199872:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869831.218338:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869831.218350:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869831.218356:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:3648:x1875765325200000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869831.218363:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869831.218367:0:22650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840eda400/0x4c16c38a9b6d0370 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d0369 expref: 18 pid: 22657 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.218377:0:22650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840eda400/0x4c16c38a9b6d0370 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6d0369 expref: 18 pid: 22657 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.218389:0:22650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d04c7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.218403:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d04c7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.218416:0:22650:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d04c7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.218423:0:22650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d04c7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.218429:0:22650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d04c7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.218436:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d04c7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.218440:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869831.218445:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d04c7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.218451:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d04c7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.218459:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d04c7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869831.218469:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869831.218496:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:3648:x1875765325200000:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869831.218503:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869831.218544:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3648:1875765325200000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869831.218578:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3651:1875765325199872:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869831.219137:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbb4600/0x4c16c38a9b6d0473 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6d046c expref: 17 pid: 22659 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869831.219149:0:23820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23820:1875765325199616:0@lo:104: 00010000:00010000:1.0:1788869831.219159:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840eda400/0x4c16c38a9b6d0370 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6d0369 expref: 16 pid: 22657 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869831.219166:0:23820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23820:1875765325199744:0@lo:104: 00010000:00010000:1.0:1788869831.219181:0:23820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d04c7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869831.219190:0:23820:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d04c7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869831.219208:0:23820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d04c7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869831.219213:0:23820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d04c7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869831.493825:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869821/real 1788869821] req@ffff8e270402ce00 x1875765325193984/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869831 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869831.493872:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e270402ce00 x1875765325193984/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869831 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869831.493884:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869821/real 1788869821] req@ffff8e270402d880 x1875765325193856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869831 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869831.493897:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e270402d880 x1875765325193856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869831 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788869831.493919:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e27029d0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869831.494015:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788869831.494020:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325193984:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788869831.494027:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282d8c8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788869831.496957:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869831.496967:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869831.496970:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869831.496973:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869831.497017:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869831.497021:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788869831.497025:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e282d8c8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869831.497035:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 755 00000100:00080000:0.0:1788869831.497041:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788869831.497058:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e282d8c8000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869831.497088:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282f045c00 x1875765325200512/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869831.497103:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869831.497128:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788869831.497131:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e27029d0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869831.497135:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 755 00000100:00080000:0.0:1788869831.497139:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788869831.497145:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e27029d0800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869831.497160:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282f046300 x1875765325200640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788869831.497208:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325200256:0@lo:400:kworker.0 00000100:00100000:0.0:1788869831.497293:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869831.497344:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869831.497350:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325200384:0@lo:400:kworker.0 00000100:00100000:0.0:1788869831.497376:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869831.497415:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325200256 00000100:00100000:0.0:1788869831.497426:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325200256 00000100:00100000:0.0:1788869831.497513:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788869831.497525:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325200256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869831.497616:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325200256:12345-0@lo:400:kworker.0 Request processed in 92us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869831.497623:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788869831.497671:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e282f047100 x1875765325200256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869831.497685:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325200256:0@lo:400:kworker.0 00000100:00100000:3.0:1788869831.497976:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325200768:0@lo:400:kworker.0 00000100:00100000:3.0:1788869831.498023:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869831.498053:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869831.498059:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325200128:0@lo:400:kworker.0 00000100:00100000:3.0:1788869831.498098:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869831.498308:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325200384 00000100:00100000:1.0:1788869831.498313:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325200384 00000100:00100000:1.0:1788869831.498350:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325200128 00000100:00100000:1.0:1788869831.498353:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325200128 00000100:00100000:1.0:1788869831.498367:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788869831.498374:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325200384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869831.498420:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325200384:12345-0@lo:400:kworker.0 Request processed in 46us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869831.498427:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788869831.498460:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869831.498466:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875765325200128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869831.498501:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875765325200128:12345-0@lo:400:kworker.0 Request processed in 34us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869831.498506:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869831.498536:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325200128:0@lo:400:kworker.0 00000100:00080000:2.0:1788869831.498722:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788869831.498729:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325193856:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788869831.498756:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325200512:0@lo:8:kworker.0 00000400:00000100:2.0:1788869831.498803:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765325200512 offset 0 length 520: 4 00000100:00100000:2.0:1788869831.498832:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325200640:0@lo:8:kworker.0 00000400:00000100:2.0:1788869831.498852:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875765325200640 offset 0 length 520: 4 00000100:00100000:0.0:1788869831.499048:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325200768 00000100:00100000:0.0:1788869831.499055:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325200768 00000100:00100000:0.0:1788869831.499098:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788869831.499106:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325200768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869831.499175:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325200768:12345-0@lo:400:kworker.0 Request processed in 69us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869831.499182:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788869831.499215:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325200384:0@lo:400:kworker.0 00010000:00080000:2.0:1788869831.499379:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e282f044a80 x1875765325200768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869831.499390:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325200768:0@lo:400:kworker.0 00000100:00080000:1.0:1788869831.499571:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869831.499577:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788869831.499579:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869831.499582:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788869831.621831:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869832.518670:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869832.518704:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325200896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869832.518812:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869832.518893:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325200896 00000100:00100000:0.0:1788869832.518905:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325200896 00000100:00100000:0.0:1788869832.518986:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788869832.518999:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875765325200896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869832.519049:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788869832.519117:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875765325200896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869832.519125:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788869832.519196:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325200896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869832.520139:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869832.521503:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325201024:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869832.521634:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869832.524270:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325201024 00000100:00100000:1.0:1788869832.524303:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325201024 00000100:00100000:1.0:1788869832.524397:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788869832.524580:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325201024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869832.524664:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788869832.524781:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325201024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 206us (3147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869832.524895:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325201024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869832.535541:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 10000000:01000000:2.0:1788869832.645678:0:22661:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788869832.645692:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2704079800 from 13 10000000:01000000:2.0:1788869832.645701:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788869832.645773:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d04ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869832.645793:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d04ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869832.645809:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d04ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869832.645856:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325201152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788869832.645947:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869832.646006:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282dbb76c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788869832.646023:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869832.646077:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325201152 00000100:00100000:3.0:1788869832.646088:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325201152 00000100:00100000:3.0:1788869832.646162:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788869832.646174:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+16:22661:x1875765325201152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869832.646192:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869832.646218:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840ed8800/0x4c16c38a9b6d04d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d04ce expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869832.646249:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed8800/0x4c16c38a9b6d04d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d04ce expref: 17 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869832.646261:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840ed8800/0x4c16c38a9b6d04d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d04ce expref: 17 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869832.646272:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8800, rc 0) 00000100:00100000:3.0:1788869832.646335:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:22661:x1875765325201152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869832.646342:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788869832.646713:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325201152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869832.646731:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d04ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d04d5 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869832.646740:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d04ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d04d5 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869832.646845:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325201280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869832.646883:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869832.646920:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282dbb76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869832.646983:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325201280 00000100:00100000:3.0:1788869832.646989:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325201280 00000100:00100000:3.0:1788869832.647028:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788869832.647035:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:22661:x1875765325201280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869832.647494:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:22661:x1875765325201280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 456us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869832.647503:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788869832.652668:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325201280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869832.652807:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325201408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869832.653087:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869832.653156:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282dbb76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788869832.653945:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325201408 00000100:00100000:0.0:1788869832.653960:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325201408 00000100:00100000:0.0:1788869832.654039:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788869832.654053:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:22661:x1875765325201408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869832.654258:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:22661:x1875765325201408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869832.654267:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788869832.655199:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325201408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788869832.657902:0:23859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788869832.658129:0:22661:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788869832.658172:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869832.658189:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d04ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d04d5 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869832.658204:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d04ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d04d5 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869832.658218:0:22661:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788869832.658221:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e283b011000 from 13 10000000:01000000:1.0:1788869832.658225:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869832.659487:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d04dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869832.659506:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d04dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869832.659523:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d04dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869832.659617:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325201536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869832.659716:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869832.659774:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e283c82b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869832.660177:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325201536 00000100:00100000:3.0:1788869832.660190:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325201536 00000100:00100000:3.0:1788869832.660275:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788869832.660288:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+17:22661:x1875765325201536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869832.660308:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869832.660572:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d04e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d04dc expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869832.668233:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d04e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d04dc expref: 18 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869832.668263:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d04e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d04dc expref: 18 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869832.668277:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8200, rc 0) 00000100:00100000:3.0:1788869832.668417:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:22661:x1875765325201536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 8121us (8690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869832.668428:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788869832.668806:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325201536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869832.668849:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d04dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d04e3 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869832.668861:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d04dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d04e3 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869832.668986:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325201664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869832.669040:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869832.669090:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e283c82b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869832.669203:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325201664 00000100:00100000:3.0:1788869832.669213:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325201664 00000100:00100000:3.0:1788869832.669268:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788869832.669279:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:22661:x1875765325201664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788869832.669564:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:22661:x1875765325201664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869832.669619:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788869832.672421:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325201664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869832.672518:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325201792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869832.672641:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869832.672703:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e283c82b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869832.672875:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325201792 00000100:00100000:3.0:1788869832.672889:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325201792 00000100:00100000:3.0:1788869832.672984:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788869832.672997:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:22661:x1875765325201792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869832.673184:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:22661:x1875765325201792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869832.673194:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788869832.673950:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325201792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788869832.681193:0:23862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788869832.681404:0:22661:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788869832.681460:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869832.681480:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d04dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d04e3 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869832.681497:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d04dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d04e3 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788869833.043113:0:23398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788869833.670956:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869834.377043:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788869834.694019:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869835.717910:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788869836.615368:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869836.615376:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869836.615379:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869836.615382:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869836.615403:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869836.615407:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869836.615409:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869836.615412:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788869836.615451:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325202304:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.615660:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869836.615712:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788869836.615719:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325201920:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.615761:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869836.615783:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325202432:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.615806:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869836.615833:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325202176:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.615868:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869836.615886:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869836.615892:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325202048:0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.615914:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869836.616078:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325201920 00000100:00100000:2.0:1788869836.616086:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325201920 00000100:00100000:2.0:1788869836.619123:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788869836.619145:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805cbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:3650:x1875765325201920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869836.622547:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805cbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:3650:x1875765325201920:12345-0@lo:400:kworker.0 Request processed in 3399us (6774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869836.622564:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788869836.622772:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325202304 00000100:00100000:0.0:1788869836.622782:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325202304 00000100:00100000:0.0:1788869836.622832:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325202048 00000100:00100000:0.0:1788869836.622835:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325202048 00000100:00100000:0.0:1788869836.622865:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788869836.622875:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325202304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869836.622945:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325202304:12345-0@lo:400:kworker.0 Request processed in 72us (7286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869836.622952:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788869836.622965:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869836.622971:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325202048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869836.623008:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325202048:12345-0@lo:400:kworker.0 Request processed in 38us (7093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869836.623014:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869836.623031:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325202432 00000100:00100000:0.0:1788869836.623034:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325202432 00000100:00100000:0.0:1788869836.623056:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325202176 00000100:00100000:0.0:1788869836.623058:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325202176 00000100:00100000:0.0:1788869836.623077:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869836.623083:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325202432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869836.623114:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325202432:12345-0@lo:400:kworker.0 Request processed in 32us (7307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869836.623120:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869836.623132:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788869836.623138:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325202176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869836.623166:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325202176:12345-0@lo:400:kworker.0 Request processed in 28us (7297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869836.623187:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869836.625538:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325201920:0@lo:400:kworker.0 00010000:00080000:3.0:1788869836.625562:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e270402ca80 x1875765325202432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869836.625575:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325202432:0@lo:400:kworker.0 00000100:00100000:3.0:1788869836.625612:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325202304:0@lo:400:kworker.0 00000100:00100000:3.0:1788869836.625665:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325202048:0@lo:400:kworker.0 00010000:00080000:3.0:1788869836.625679:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e270402dc00 x1875765325202176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869836.625689:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325202176:0@lo:400:kworker.0 00010000:00010000:3.0:1788869836.742790:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788869837.318498:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788869837.637977:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788869837.641132:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325202688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869837.641221:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869837.641263:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325202560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869837.641306:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869837.641368:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325202688 00000100:00100000:2.0:1788869837.641376:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325202688 00000100:00100000:2.0:1788869837.641420:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325202560 00000100:00100000:2.0:1788869837.641433:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325202560 00000100:00100000:2.0:1788869837.641451:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869837.641459:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325202688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869837.641497:0:23407:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788869837.641561:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325202688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869837.641569:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788869837.641604:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788869837.641611:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325202560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869837.642094:0:23407:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788869837.642132:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325202560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 521us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869837.642138:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788869837.642189:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325202688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869837.642204:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325202560:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788869837.766023:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869838.790779:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869839.815092:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788869840.042570:0:24169:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788869840.042576:0:24169:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788869840.042578:0:24169:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788869840.043956:0:24169:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e282da78000 00000020:01000004:1.0:1788869840.043979:0:24169:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788869840.043995:0:24169:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788869840.044012:0:24169:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e28411e0000) 00000020:00000080:1.0:1788869840.044043:0:24169:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788869840.123635:0:24169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788869840.125518:0:24169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788869840.126212:0:24169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788869840.132357:0:24169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788869840.132713:0:24169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788869840.133536:0:24169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788869840.134197:0:24169:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1788869840.151099:0:24169:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788869840.151359:0:24169:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788869840.151375:0:24169:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788869840.151390:0:24169:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4c16c38a9b6d04f1 00000020:01000004:1.0:1788869840.151401:0:24169:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788869840.151426:0:24169:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788869840.151430:0:24169:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788869840.151436:0:24169:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788869840.151441:0:24169:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788869840.151454:0:24169:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e28411e4d40) 00000020:00000080:1.0:1788869840.151465:0:24169:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1788869840.171404:0:24169:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869840.171670:0:24169:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788869840.171677:0:24169:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788869840.184720:0:24169:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788869840.184737:0:24169:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788869840.185259:0:24169:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788869840.185266:0:24169:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788869840.187053:0:24169:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788869840.187327:0:24169:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788869840.187335:0:24169:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788869840.188810:0:24169:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788869840.188823:0:24169:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788869840.222785:0:24169:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788869840.223386:0:24169:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788869840.223465:0:24169:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788869840.226148:0:24169:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788869840.226164:0:24169:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788869840.228819:0:24169:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788869840.228832:0:24169:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788869840.232878:0:24169:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788869840.233092:0:24169:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788869840.233099:0:24169:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788869840.236187:0:24169:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788869840.236212:0:24169:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788869840.311091:0:24169:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788869840.311973:0:24169:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788869840.311985:0:24169:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788869840.317475:0:24169:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788869840.317499:0:24169:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788869840.318401:0:24169:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788869840.318437:0:24169:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788869840.318445:0:24169:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788869840.342885:0:24169:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788869840.342941:0:24169:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.154@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788869840.342947:0:24169:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788869840.342948:0:24169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788869840.342950:0:24169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869840.342951:0:24169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869840.342952:0:24169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869840.342953:0:24169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869840.342955:0:24169:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869840.342957:0:24169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869840.342959:0:24169:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788869840.342963:0:24169:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788869840.342965:0:24169:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788869840.342966:0:24169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788869840.342968:0:24169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869840.342969:0:24169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869840.342970:0:24169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869840.342971:0:24169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869840.342972:0:24169:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869840.342973:0:24169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869840.342974:0:24169:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788869840.343021:0:24169:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788869840.343044:0:24169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325202816:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788869840.343130:0:24169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869840.343204:0:24169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869840.344813:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325202816 00000100:00100000:1.0:1788869840.344837:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325202816 00000100:00100000:1.0:1788869840.345056:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788869840.345069:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805cbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:24169:x1875765325202816:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788869840.345668:0:22658:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788869840.345673:0:22658:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788869840.345677:0:22658:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788869840.348411:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805cbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:24169:x1875765325202816:12345-0@lo:253:mount.lustre.0 Request processed in 3335us (5270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869840.348449:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788869840.349253:0:24169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325202816:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788869840.349273:0:24169:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788869840.349277:0:24169:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788869840.349278:0:24169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788869840.349280:0:24169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788869840.349293:0:24169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788869840.349295:0:24169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788869840.349296:0:24169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788869840.349297:0:24169:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788869840.349299:0:24169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788869840.349301:0:24169:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788869840.349324:0:24169:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e282da78000 from lustre-OST0000 10000000:01000000:2.0:1788869840.349358:0:24169:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788869840.349360:0:24169:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788869840.349368:0:24169:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e27029cb380 local copy 00010000:00010000:2.0:1788869840.349380:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9800/0x4c16c38a9b6d02ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d02b3 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869840.350994:0:24169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325202944:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869840.351063:0:24169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869840.351185:0:24169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540780 going to sleep for 11 seconds 00000100:00100000:0.0:1788869840.351412:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325202944 00000100:00100000:0.0:1788869840.351422:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325202944 00000100:00100000:0.0:1788869840.351621:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788869840.351633:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805cbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:24169:x1875765325202944:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869840.351758:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805cbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:24169:x1875765325202944:12345-0@lo:501:mount.lustre.0 Request processed in 129us (694us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788869840.351766:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788869840.351846:0:24169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325202944:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788869840.351862:0:24169:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788869840.351880:0:24169:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788869840.351888:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9800/0x4c16c38a9b6d02ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d02b3 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.351899:0:24169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9800/0x4c16c38a9b6d02ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d02b3 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869840.351926:0:24169:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e282da78000 10000000:01000000:2.0:1788869840.351932:0:24169:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788869840.351938:0:24169:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788869840.351940:0:24169:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788869840.351945:0:24169:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788869840.351948:0:24169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788869840.351981:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d04ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.351989:0:24169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d04ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.351998:0:24169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d04ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869840.352012:0:24169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325203072:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788869840.352042:0:24169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869840.354260:0:24169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540780 going to sleep for 11 seconds 00000100:00100000:3.0:1788869840.354423:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325203072 00000100:00100000:3.0:1788869840.354434:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325203072 00000100:00100000:3.0:1788869840.354497:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788869840.354507:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+18:24169:x1875765325203072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869840.354522:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869840.354558:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840ed8600/0x4c16c38a9b6d0506 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d04ff expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.354626:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed8600/0x4c16c38a9b6d0506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d04ff expref: 19 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.354650:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840ed8600/0x4c16c38a9b6d0506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d04ff expref: 19 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.354659:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8600, rc 0) 00000100:00100000:3.0:1788869840.354787:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+19:24169:x1875765325203072:12345-0@lo:101:mount.lustre.0 Request processed in 215us (2677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869840.354796:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788869840.354958:0:24169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325203072:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869840.354975:0:24169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d04ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0506 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.354984:0:24169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d04ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d0506 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869840.357576:0:24169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1788869840.359010:0:24169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869840.362905:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788869840.362973:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788869840.362991:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788869840.363003:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788869840.363016:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788869840.363030:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788869840.363044:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788869840.363058:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788869840.363070:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788869840.363095:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788869840.363115:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1788869840.363146:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1788869840.363175:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1788869840.363181:0:24169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1788869840.363419:0:24169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325203200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869840.364002:0:24169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869840.364113:0:24169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28175400c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869840.365034:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325203200 00000100:00100000:3.0:1788869840.365046:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325203200 00000100:00100000:3.0:1788869840.365165:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788869840.365176:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+19:24169:x1875765325203200:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869840.365418:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+19:24169:x1875765325203200:12345-0@lo:501:mount.lustre.0 Request processed in 242us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869840.365428:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788869840.365558:0:24169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325203200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869840.365687:0:24169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325203328:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869840.365751:0:24169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869840.370225:0:24169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28175400c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869840.370405:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325203328 00000100:00100000:1.0:1788869840.370418:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325203328 00000100:00100000:1.0:1788869840.370502:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788869840.370514:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+19:24169:x1875765325203328:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869840.371922:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+19:24169:x1875765325203328:12345-0@lo:503:mount.lustre.0 Request processed in 1404us (6165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869840.371936:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788869840.372200:0:24169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325203328:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788869840.373127:0:24169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788869840.374021:0:24169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325203456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869840.374101:0:24169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869840.374159:0:24169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540780 going to sleep for 11 seconds 00000100:00100000:3.0:1788869840.375253:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325203456 00000100:00100000:3.0:1788869840.375266:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325203456 00000100:00100000:3.0:1788869840.375347:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788869840.375359:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+19:24169:x1875765325203456:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869840.376322:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+19:24169:x1875765325203456:12345-0@lo:502:mount.lustre.0 Request processed in 961us (2216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869840.376333:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788869840.376628:0:24169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325203456:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869840.377052:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788869840.377544:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788869840.377571:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788869840.377650:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788869840.377671:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788869840.377685:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788869840.377699:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788869840.377712:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788869840.377723:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1788869840.377753:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1788869840.377781:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1788869840.377798:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1788869840.377865:0:24169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325203584:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869840.377939:0:24169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869840.377999:0:24169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540780 going to sleep for 11 seconds 00000100:00100000:0.0:1788869840.378237:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325203584 00000100:00100000:0.0:1788869840.378248:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325203584 00000100:00100000:0.0:1788869840.378305:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788869840.378315:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+19:24169:x1875765325203584:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869840.378486:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+19:24169:x1875765325203584:12345-0@lo:502:mount.lustre.0 Request processed in 171us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869840.378495:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788869840.378781:0:24169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325203584:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869840.378836:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1788869840.379193:0:24169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788869840.381044:0:24186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788869840.381056:0:24186:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788869840.381063:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788869840.381065:0:24186:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788869840.381072:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788869840.381094:0:24186:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e28411e19c0) 00000020:00000080:1.0:1788869840.381123:0:24186:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788869840.381144:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788869840.381243:0:24186:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e282da78000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788869840.381252:0:24186:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788869840.381260:0:24186:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4c16c38a9b6d0514 00010000:00010000:1.0:1788869840.389408:0:24186:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788869840.391207:0:24186:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:1.0:1788869840.397795:0:24186:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1788869840.399767:0:24186:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788869840.399780:0:24186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869840.399788:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869840.399790:0:24186:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788869840.399793:0:24186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788869840.399796:0:24186:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1788869840.399797:0:24186:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788869840.399799:0:24186:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788869840.399800:0:24186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788869840.399803:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869840.399804:0:24186:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788869840.399807:0:24186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869840.399815:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869840.399817:0:24186:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788869840.399820:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788869840.399823:0:24186:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788869840.399825:0:24186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869840.399828:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869840.399830:0:24186:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788869840.399832:0:24186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788869840.399835:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869840.399836:0:24186:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788869840.399850:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788869840.399901:0:24186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788869840.399905:0:24186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788869840.399906:0:24186:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788869840.399910:0:24186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788869840.400167:0:24169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788869840.400198:0:24169:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788869840.400222:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d04ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0506 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.400236:0:24169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2842042200/0x4c16c38a9b6d04ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0506 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869840.400244:0:24169:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e282da78000 from 1 10000000:01000000:2.0:1788869840.400247:0:24169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788869840.400285:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842043e00/0x4c16c38a9b6d051b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.400294:0:24169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2842043e00/0x4c16c38a9b6d051b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.400307:0:24169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2842043e00/0x4c16c38a9b6d051b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869840.400335:0:24169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325203712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788869840.400417:0:24169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869840.400461:0:24169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540780 going to sleep for 11 seconds 00000100:00100000:1.0:1788869840.401745:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325203712 00000100:00100000:1.0:1788869840.401773:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325203712 00000100:00100000:1.0:1788869840.401835:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788869840.401851:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+19:24169:x1875765325203712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869840.401865:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869840.401881:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6d0522 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d051b expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.401927:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6d0522 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d051b expref: 20 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.401939:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6d0522 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d051b expref: 20 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.401949:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edac00, rc 0) 00000100:00100000:1.0:1788869840.402021:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+20:24169:x1875765325203712:12345-0@lo:101:mount.lustre.0 Request processed in 173us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869840.402028:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788869840.402269:0:24169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325203712:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869840.402287:0:24169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2842043e00/0x4c16c38a9b6d051b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0522 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.402297:0:24169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2842043e00/0x4c16c38a9b6d051b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d0522 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788869840.418494:0:24169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1788869840.420221:0:24169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788869840.420508:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788869840.420541:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788869840.420557:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788869840.420571:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788869840.420608:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788869840.420626:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788869840.420652:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788869840.420669:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788869840.420683:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788869840.420698:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1788869840.420713:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1788869840.422047:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1788869840.422065:0:24169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1788869840.422192:0:24169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f047b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325203840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869840.422267:0:24169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869840.422322:0:24169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0db480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869840.422611:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325203840 00000100:00100000:3.0:1788869840.422627:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325203840 00000100:00100000:3.0:1788869840.422690:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788869840.422699:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+20:24169:x1875765325203840:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869840.422832:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+20:24169:x1875765325203840:12345-0@lo:501:mount.lustre.0 Request processed in 133us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869840.422840:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788869840.424417:0:24169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f047b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325203840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869840.424495:0:24169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f047b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325203968:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869840.424570:0:24169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869840.424648:0:24169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0db480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869840.425237:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325203968 00000100:00100000:3.0:1788869840.425248:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325203968 00000100:00100000:3.0:1788869840.425309:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788869840.425319:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+20:24169:x1875765325203968:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869840.425483:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+20:24169:x1875765325203968:12345-0@lo:503:mount.lustre.0 Request processed in 163us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869840.425494:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788869840.429283:0:24169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f047b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325203968:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788869840.435682:0:24169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788869840.436239:0:24169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f047b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325204096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869840.436333:0:24169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869840.436374:0:24169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0db480 going to sleep for 11 seconds 00000100:00100000:1.0:1788869840.438025:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325204096 00000100:00100000:1.0:1788869840.438041:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325204096 00000100:00100000:1.0:1788869840.438115:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788869840.438126:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+20:24169:x1875765325204096:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869840.438304:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+20:24169:x1875765325204096:12345-0@lo:502:mount.lustre.0 Request processed in 179us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869840.438311:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788869840.441666:0:24169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f047b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325204096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788869840.441988:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788869840.442023:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788869840.442047:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788869840.442080:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788869840.442098:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788869840.442111:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788869840.442123:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788869840.442137:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1788869840.442149:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788869840.442162:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1788869840.442176:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1788869840.442232:0:24169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f047b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325204224:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869840.442316:0:24169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869840.442363:0:24169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0db480 going to sleep for 11 seconds 00000100:00100000:3.0:1788869840.442629:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325204224 00000100:00100000:3.0:1788869840.442647:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325204224 00000100:00100000:3.0:1788869840.442706:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788869840.442717:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+20:24169:x1875765325204224:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869840.442961:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+20:24169:x1875765325204224:12345-0@lo:502:mount.lustre.0 Request processed in 246us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869840.442969:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788869840.444172:0:24169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f047b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325204224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788869840.444431:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788869840.444645:0:24169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788869840.448951:0:24190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869840.448966:0:24190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869840.448968:0:24190:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788869840.448978:0:24190:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e282da78000 00000020:00000080:2.0:1788869840.448981:0:24190:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788869840.448990:0:24190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869840.448993:0:24190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869840.448994:0:24190:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788869840.448996:0:24190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869840.448998:0:24190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869840.448999:0:24190:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788869840.449002:0:24190:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e282da78000 00000020:00000080:2.0:1788869840.449004:0:24190:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788869840.449113:0:24190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788869840.449118:0:24190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869840.449119:0:24190:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788869840.449122:0:24190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788869840.449125:0:24190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788869840.449126:0:24190:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788869840.449129:0:24190:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e282da78000 00000020:00000080:2.0:1788869840.449144:0:24190:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788869840.449952:0:24190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869840.452280:0:24190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869840.452292:0:24190:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788869840.452305:0:24190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869840.452314:0:24190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869840.452315:0:24190:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788869840.452321:0:24190:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e282da78000 00000020:00000080:3.0:1788869840.452330:0:24190:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788869840.452856:0:24190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869840.452865:0:24190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869840.452866:0:24190:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788869840.452870:0:24190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788869840.452986:0:24169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788869840.453019:0:24169:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869840.453042:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842043e00/0x4c16c38a9b6d051b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0522 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.453055:0:24169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2842043e00/0x4c16c38a9b6d051b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0522 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869840.453114:0:24169:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788869840.453117:0:24169:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e282da78000 10000000:01000000:2.0:1788869840.453119:0:24169:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e282da78000 10000000:01000000:2.0:1788869840.453124:0:24169:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788869840.453131:0:24169:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e282da78000 from 1 10000000:01000000:2.0:1788869840.453134:0:24169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788869840.453173:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d0529 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.453181:0:24169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d0529 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.453193:0:24169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d0529 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869840.453222:0:24169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325204352:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788869840.453310:0:24169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869840.453365:0:24169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869840.453384:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325204352 00000100:00100000:3.0:1788869840.453565:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325204352 00000100:00100000:3.0:1788869840.453648:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788869840.453660:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+20:24169:x1875765325204352:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869840.453675:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869840.453689:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840ed9200/0x4c16c38a9b6d0530 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d0529 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.453803:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed9200/0x4c16c38a9b6d0530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d0529 expref: 21 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.453816:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840ed9200/0x4c16c38a9b6d0530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d0529 expref: 21 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.453825:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9200, rc 0) 00000100:00100000:3.0:1788869840.453869:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:24169:x1875765325204352:12345-0@lo:101:mount.lustre.0 Request processed in 212us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869840.453876:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788869840.454627:0:24169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325204352:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869840.454670:0:24169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d0529 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0530 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.454691:0:24169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d0529 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d0530 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788869840.461169:0:24169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788869840.461630:0:24169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788869840.462909:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788869840.462951:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788869840.462965:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788869840.462980:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788869840.462992:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788869840.463006:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788869840.463027:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788869840.463039:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788869840.463067:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788869840.463163:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788869840.463184:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788869840.463199:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788869840.463212:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788869840.463300:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788869840.463314:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788869840.463328:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788869840.463342:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788869840.463490:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788869840.463508:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788869840.463522:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788869840.463534:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788869840.463548:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788869840.463560:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788869840.463574:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788869840.463682:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788869840.463699:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788869840.463711:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788869840.463791:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788869840.463808:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788869840.463819:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788869840.463830:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788869840.463840:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788869840.463851:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788869840.463863:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788869840.463877:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788869840.463889:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788869840.463901:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788869840.463915:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788869840.463930:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788869840.463956:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788869840.463983:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788869840.463997:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788869840.464011:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788869840.464024:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788869840.464035:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788869840.464048:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788869840.464060:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788869840.464073:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788869840.464648:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788869840.464672:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788869840.464689:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788869840.464694:0:24169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788869840.464879:0:24169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325204480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869840.464956:0:24169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869840.464997:0:24169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27029969c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869840.465072:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325204480 00000100:00100000:1.0:1788869840.465157:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325204480 00000100:00100000:1.0:1788869840.465207:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788869840.471685:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:24169:x1875765325204480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869840.472547:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:24169:x1875765325204480:12345-0@lo:501:mount.lustre.0 Request processed in 7327us (7587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869840.472560:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788869840.472903:0:24169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325204480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869840.472965:0:24169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325204608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869840.473014:0:24169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869840.473060:0:24169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27029969c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869840.474024:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325204608 00000100:00100000:1.0:1788869840.474038:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325204608 00000100:00100000:1.0:1788869840.474195:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788869840.474208:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:24169:x1875765325204608:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869840.474673:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:24169:x1875765325204608:12345-0@lo:503:mount.lustre.0 Request processed in 466us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869840.474681:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788869840.474867:0:24169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325204608:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788869840.475967:0:24169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788869840.476065:0:24169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325204736:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869840.476293:0:24169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869840.476401:0:24169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27029969c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869840.482534:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325204736 00000100:00100000:1.0:1788869840.482555:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325204736 00000100:00100000:1.0:1788869840.482626:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788869840.482648:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:24169:x1875765325204736:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869840.483273:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:24169:x1875765325204736:12345-0@lo:502:mount.lustre.0 Request processed in 636us (6978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869840.483282:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788869840.484628:0:24169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325204736:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788869840.485127:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788869840.485185:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788869840.485201:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788869840.485212:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788869840.485225:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788869840.485235:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788869840.485245:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788869840.485256:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788869840.485267:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788869840.485279:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788869840.485292:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788869840.485306:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788869840.485318:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788869840.485330:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788869840.485344:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788869840.485373:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788869840.485696:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788869840.485797:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788869840.485813:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788869840.485824:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788869840.485835:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788869840.485845:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788869840.485855:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788869840.485869:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788869840.485883:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1788869840.485896:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1788869840.485909:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1788869840.485923:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1788869840.485936:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1788869840.485950:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1788869840.485963:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1788869840.485974:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1788869840.485986:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1788869840.486010:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1788869840.486031:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1788869840.486043:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1788869840.486055:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1788869840.486067:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1788869840.486093:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1788869840.486106:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1788869840.486118:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1788869840.486131:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1788869840.486146:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1788869840.486157:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1788869840.486170:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1788869840.486182:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1788869840.486193:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1788869840.486205:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1788869840.486284:0:24169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325204864:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869840.486825:0:24169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869840.486880:0:24169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27029969c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869840.486938:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325204864 00000100:00100000:2.0:1788869840.486947:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325204864 00000100:00100000:2.0:1788869840.486992:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788869840.487002:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:24169:x1875765325204864:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869840.487362:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:24169:x1875765325204864:12345-0@lo:502:mount.lustre.0 Request processed in 351us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869840.487372:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788869840.496283:0:24169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325204864:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788869840.497254:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1788869840.497287:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1788869840.497328:0:24169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325204992:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869840.497627:0:24169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869840.497677:0:24169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27029969c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869840.498974:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325204992 00000100:00100000:1.0:1788869840.498989:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325204992 00000100:00100000:1.0:1788869840.499055:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788869840.499065:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:24169:x1875765325204992:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869840.504295:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:24169:x1875765325204992:12345-0@lo:502:mount.lustre.0 Request processed in 5219us (6655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869840.504311:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788869840.504439:0:24169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325204992:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788869840.504567:0:24169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1788869840.504608:0:24169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788869840.515126:0:24196:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788869840.515145:0:24196:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e27025e99c0) 00000020:00000080:3.0:1788869840.515168:0:24196:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788869840.515253:0:24196:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e282da78000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788869840.515257:0:24196:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e282da78000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788869840.515259:0:24196:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e282da78000 3 00010000:00080000:3.0:1788869840.515297:0:24196:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2702b8d800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.154@tcp at head 00010000:00010000:2.0:1788869840.524595:0:24196:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788869840.524903:0:24196:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788869840.525002:0:24196:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788869840.525017:0:24196:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4c16c38a9b6d053e 00000100:00080000:2.0:1788869840.525029:0:24196:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869840.525044:0:24196:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e2702b8d800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869840.525104:0:24196:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e270402ea00 x1875765325205120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869840.525131:0:24196:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788869840.525156:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765325205120:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788869840.525182:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869840.525186:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869840.525189:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869840.525192:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869840.525224:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869840.525234:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788869840.525237:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788869840.525240:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788869840.525243:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869840.525275:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325205376:0@lo:400:kworker.0 00000100:00100000:2.0:1788869840.525304:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869840.525305:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325205248:0@lo:400:kworker.0 00000100:00100000:3.0:1788869840.535906:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325205120 00000100:00100000:3.0:1788869840.535927:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325205120 00000100:00100000:3.0:1788869840.536027:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325205376 00000100:00100000:3.0:1788869840.536031:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325205376 00000100:00100000:3.0:1788869840.536091:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869840.536103:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325205376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869840.536328:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325205376:12345-0@lo:400:kworker.0 Request processed in 227us (11022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869840.536335:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788869840.536355:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788869840.536360:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875765325205120:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788869840.536389:0:22664:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 774 last 0 00000020:00000080:3.0:1788869840.536428:0:22664:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4c16c38a9b6d0545 00000004:00100000:3.0:1788869840.536451:0:22664:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788869840.536499:0:22664:0:(import.c:65:import_set_state_nolock()) ffff8e2702b8e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869840.536545:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875765325205120:12345-0@lo:38:llog_process_th.0 Request processed in 184us (11302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869840.536552:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788869840.536655:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e270402ea00 x1875765325205120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869840.536682:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788869840.536691:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788869840.536699:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788869840.536704:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788869840.536706:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2702b8d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788869840.536712:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875765325205120:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788869840.536753:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869840.539666:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325205504:0@lo:400:kworker.0 00000100:00100000:1.0:1788869840.539758:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869840.542239:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325205632:0@lo:400:kworker.0 00000100:00100000:0.0:1788869840.542318:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1788869840.542683:0:24196:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788869840.542701:0:24196:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8e27029c99c0) 00000020:00000080:0.0:1788869840.542725:0:24196:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1788869840.542829:0:24196:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e282da78000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788869840.542834:0:24196:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e282da78000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788869840.542837:0:24196:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e282da78000 3 00010000:00080000:0.0:1788869840.542870:0:24196:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2827a90800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.154@tcp at head 00000100:00100000:2.0:1788869840.543711:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325205248 00000100:00100000:2.0:1788869840.543737:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325205248 00000100:00100000:2.0:1788869840.543777:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325205504 00000100:00100000:2.0:1788869840.543780:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325205504 00000100:00100000:2.0:1788869840.543795:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788869840.543803:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325205248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869840.543889:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325205248:12345-0@lo:400:kworker.0 Request processed in 86us (7135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869840.543897:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788869840.543913:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788869840.543919:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325205504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869840.543953:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325205504:12345-0@lo:400:kworker.0 Request processed in 35us (4197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869840.543959:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788869840.543981:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325205632 00000100:00100000:2.0:1788869840.543984:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325205632 00000100:00100000:2.0:1788869840.544007:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788869840.544013:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325205632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869840.544051:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325205632:12345-0@lo:400:kworker.0 Request processed in 38us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869840.544070:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788869840.544517:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325205248:0@lo:400:kworker.0 00000100:00100000:2.0:1788869840.544564:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325205504:0@lo:400:kworker.0 00010000:00080000:2.0:1788869840.544625:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e270402f800 x1875765325205632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869840.544649:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325205632:0@lo:400:kworker.0 00010000:00080000:2.0:1788869840.544680:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e270402ce00 x1875765325205376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869840.544688:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325205376:0@lo:400:kworker.0 00010000:00010000:2.0:1788869840.549352:0:24196:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788869840.549541:0:24196:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788869840.549616:0:24196:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788869840.549641:0:24196:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x4c16c38a9b6d0553 00000100:00080000:2.0:1788869840.549652:0:24196:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788869840.549663:0:24196:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8e2827a90800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:2.0:1788869840.549703:0:24196:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e270402ce00 x1875765325205760/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788869840.549727:0:24196:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788869840.552127:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765325205760:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788869840.552213:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869840.552298:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325205760 00000100:00100000:3.0:1788869840.552306:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325205760 00000100:00100000:3.0:1788869840.552352:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788869840.552360:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875765325205760:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788869840.552392:0:23784:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 774 last 0 00000020:00000080:3.0:1788869840.552432:0:23784:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x4c16c38a9b6d055a 00000004:00100000:3.0:1788869840.552449:0:23784:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788869840.552494:0:23784:0:(import.c:65:import_set_state_nolock()) ffff8e2702b88000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869840.552557:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875765325205760:12345-0@lo:38:llog_process_th.0 Request processed in 195us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869840.552564:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788869840.552623:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e270402ce00 x1875765325205760/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869840.552646:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788869840.552655:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788869840.552677:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788869840.552681:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788869840.552683:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2827a90800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788869840.552689:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875765325205760:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788869840.553299:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869840.553307:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869840.553309:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869840.553312:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869840.553316:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869840.553319:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788869840.553328:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869840.553331:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788869840.557440:0:24196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1788869840.559027:0:24169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788869840.559074:0:24169:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788869840.559099:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d0529 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0530 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.559113:0:24169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2842042400/0x4c16c38a9b6d0529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0530 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788869840.559184:0:24169:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788869840.559187:0:24169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788869840.559188:0:24169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869840.559190:0:24169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869840.559191:0:24169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869840.559193:0:24169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869840.559194:0:24169:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869840.559196:0:24169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869840.559198:0:24169:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788869840.559202:0:24169:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788869840.559205:0:24169:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788869840.559206:0:24169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788869840.559207:0:24169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869840.559208:0:24169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869840.559210:0:24169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869840.559211:0:24169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869840.559212:0:24169:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869840.559213:0:24169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869840.559214:0:24169:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788869840.559241:0:24169:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788869840.559263:0:24169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325205888:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788869840.559337:0:24169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869840.559385:0:24169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280833d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788869840.559974:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325205888 00000100:00100000:2.0:1788869840.559984:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325205888 00000100:00100000:2.0:1788869840.560043:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788869840.560054:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:24169:x1875765325205888:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788869840.560088:0:22657:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788869840.560111:0:22657:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788869840.564924:0:22657:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788869840.564945:0:22657:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788869840.565181:0:22680:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788869840.565188:0:22680:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788869840.565224:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6d0561 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.565246:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840edbc00/0x4c16c38a9b6d04ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d04a4 expref: 21 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.565254:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6d04b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d04b2 expref: 21 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.565261:0:22680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6d0561 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.565307:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6d04b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6d04b2 expref: 21 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.565321:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6d04b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6d04b2 expref: 21 pid: 22658 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869840.565337:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875765325206016:0@lo:104: 00000100:00100000:3.0:1788869840.565403:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788869840.565492:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840edbc00/0x4c16c38a9b6d04ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6d04a4 expref: 21 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869840.565492:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325206016 00000100:00100000:1.0:1788869840.565499:0:22647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325206016 00010000:00010000:3.0:1788869840.565501:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840edbc00/0x4c16c38a9b6d04ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6d04a4 expref: 21 pid: 22659 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869840.565515:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875765325206144:0@lo:104: 00000100:00100000:3.0:1788869840.565541:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869840.565547:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788869840.565552:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702996e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869840.565557:0:22647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+3:22680:x1875765325206016:12345-0@lo:104: 00010000:00010000:1.0:1788869840.565571:0:22647:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6d04b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d04b9 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.565661:0:22647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788869840.565667:0:22647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+3:22680:x1875765325206016:12345-0@lo:104: Request processed in 111us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869840.565683:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869840.565707:0:22647:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788869840.565718:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325206144 00000100:00100000:1.0:1788869840.565722:0:22647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325206144 00000100:00100000:1.0:1788869840.565737:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788869840.565743:0:22647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283d238850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+3:22680:x1875765325206144:12345-0@lo:104: 00010000:00010000:1.0:1788869840.565750:0:22647:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6d04a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d04ab expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869840.565794:0:22647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788869840.565800:0:22647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283d238850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+3:22680:x1875765325206144:12345-0@lo:104: Request processed in 57us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869840.565806:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788869840.565931:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869840.565938:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6d04b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d04b9 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.565945:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842042600 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869840.565949:0:22652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6d04b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6d04b9 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.565957:0:22652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6d04b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6d04b9 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869840.565965:0:22652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6d04b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6d04b9 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869840.565970:0:22652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869840.566000:0:22652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6d04b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d04b9 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.566006:0:22652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869840.566024:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6d04b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d04b9 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.566031:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2842042600/0x4c16c38a9b6d04b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d04b9 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.566043:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869840.566046:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6d04a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d04ab expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.566062:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842042a00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869840.566065:0:22652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6d04a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6d04ab expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.566072:0:22652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6d04a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6d04ab expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869840.566078:0:22652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6d04a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6d04ab expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869840.566083:0:22652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869840.566097:0:22652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6d04a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d04ab expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.566103:0:22652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869840.566109:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6d04a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d04ab expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.566115:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2842042a00/0x4c16c38a9b6d04a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d04ab expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.566127:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869840.566129:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869840.566131:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869840.566137:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869840.566371:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325206272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869840.566409:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869840.566786:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869840.566795:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270402d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325206400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869840.566832:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869840.566869:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325206272 00000100:00100000:2.0:1788869840.566874:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325206272 00010000:00010000:2.0:1788869840.566897:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6d04b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d04b2 expref: 22 pid: 22658 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869840.566921:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325206400 00000100:00100000:2.0:1788869840.566923:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325206400 00010000:00010000:2.0:1788869840.566931:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840edbc00/0x4c16c38a9b6d04ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d04a4 expref: 23 pid: 22659 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869840.566941:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869840.566947:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:3650:x1875765325206272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869840.566971:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869840.566976:0:22651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6d04b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d04b2 expref: 23 pid: 22658 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.566986:0:22651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6d04b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6d04b2 expref: 23 pid: 22658 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.567001:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869840.567032:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:3650:x1875765325206272:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869840.567039:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788869840.567053:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869840.567058:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2825c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:3650:x1875765325206400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869840.567065:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869840.567069:0:22651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840edbc00/0x4c16c38a9b6d04ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d04a4 expref: 22 pid: 22659 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.567086:0:22651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840edbc00/0x4c16c38a9b6d04ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6d04a4 expref: 22 pid: 22659 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.567098:0:22651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6d0561 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.567106:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6d0561 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788869840.567121:0:22651:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010361026s 00010000:00010000:2.0:1788869840.567126:0:22651:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6d0561 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.567134:0:22651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6d0561 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.567140:0:22651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6d0561 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.567147:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6d0561 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.567152:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840ed9400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869840.567156:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6d0561 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.567163:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6d0561 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.567171:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6d0561 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869840.567187:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788869840.567343:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbb5400/0x4c16c38a9b6d04b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6d04b2 expref: 22 pid: 22658 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869840.567355:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875765325206016:0@lo:104: 00010000:00010000:3.0:1788869840.567365:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edbc00/0x4c16c38a9b6d04ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6d04a4 expref: 21 pid: 22659 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869840.567373:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875765325206144:0@lo:104: 00010000:00010000:3.0:1788869840.567393:0:22680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6d0561 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.567400:0:22680:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6d0561 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.567406:0:22680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6d0561 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869840.567412:0:22680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6d0561 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869840.569053:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+20:24169:x1875765325205888:12345-0@lo:253:mount.lustre.0 Request processed in 8992us (9707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869840.569068:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788869840.569236:0:24169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24169:1875765325205888:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788869840.569249:0:24169:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788869840.569252:0:24169:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788869840.569253:0:24169:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788869840.569255:0:24169:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869840.569256:0:24169:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869840.569257:0:24169:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869840.569259:0:24169:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869840.569260:0:24169:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869840.569262:0:24169:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869840.569263:0:24169:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788869840.569277:0:24169:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788869840.570037:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2825c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:3650:x1875765325206400:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869840.570049:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869840.570112:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325206400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869840.570121:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270402f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325206272:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1788869840.573003:0:24169:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788869840.578358:0:24169:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788869840.578373:0:24169:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788869840.578415:0:24169:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788869840.578471:0:24169:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788869840.578494:0:24169:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788869840.578533:0:24169:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788869840.586302:0:24169:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788869840.586618:0:24169:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788869840.845669:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788869841.706043:0:24249:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869841.706331:0:24249:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788869841.863070:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788869842.121047:0:22661:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788869842.121056:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2704079800 from 13 10000000:01000000:0.0:1788869842.121062:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788869842.121119:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d0568 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869842.121132:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d0568 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869842.121145:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d0568 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869842.121173:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325206528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869842.121253:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869842.121303:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280a0db840 going to sleep for 11 seconds 00000100:00100000:1.0:1788869842.121464:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325206528 00000100:00100000:1.0:1788869842.121474:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325206528 00000100:00100000:1.0:1788869842.121548:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788869842.121560:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+19:22661:x1875765325206528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869842.121630:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869842.121644:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d056f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d0568 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869842.121670:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d056f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d0568 expref: 20 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869842.121908:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d056f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d0568 expref: 20 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869842.121920:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda600, rc 0) 00000100:00100000:0.0:1788869842.122051:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+20:22661:x1875765325206528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 492us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869842.122058:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788869842.122981:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325206528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869842.123004:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d0568 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d056f expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869842.123015:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d0568 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d056f expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869842.123089:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325206656:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788869842.123139:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869842.123193:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2826812a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869842.124429:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325206656 00000100:00100000:3.0:1788869842.124442:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325206656 00000100:00100000:3.0:1788869842.124516:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788869842.124526:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+20:22661:x1875765325206656:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788869842.124555:0:22657:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788869842.124623:0:22657:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788869842.124627:0:22657:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788869842.124852:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+20:22661:x1875765325206656:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 327us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869842.124860:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788869842.125312:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325206656:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788869842.125391:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788869842.125402:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d0568 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d056f expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869842.125415:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d0568 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d056f expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869842.125437:0:22661:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788869842.125440:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e283b011000 from 13 10000000:01000000:1.0:1788869842.125454:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788869842.125487:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6d0576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869842.125495:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6d0576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869842.125514:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6d0576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869842.125534:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325206784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869842.125576:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869842.126035:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2826812a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869842.126161:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325206784 00000100:00100000:0.0:1788869842.126182:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325206784 00000100:00100000:0.0:1788869842.126233:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788869842.126242:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+20:22661:x1875765325206784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869842.126258:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869842.126271:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e282dbb4800/0x4c16c38a9b6d057d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d0576 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869842.126322:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e282dbb4800/0x4c16c38a9b6d057d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d0576 expref: 21 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869842.126333:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e282dbb4800/0x4c16c38a9b6d057d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d0576 expref: 21 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869842.126343:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e282dbb4800, rc 0) 00000100:00100000:0.0:1788869842.126387:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:22661:x1875765325206784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869842.126393:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788869842.129103:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325206784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869842.129137:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6d0576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d057d expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869842.129151:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6d0576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d057d expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869842.129256:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325206912:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788869842.129333:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869842.129382:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2826812a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869842.129464:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325206912 00000100:00100000:0.0:1788869842.129474:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325206912 00000100:00100000:0.0:1788869842.129545:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788869842.129556:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:22661:x1875765325206912:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788869842.129581:0:22658:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788869842.129638:0:22658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788869842.129642:0:22658:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788869842.129941:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:22661:x1875765325206912:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 386us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869842.129950:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788869842.130094:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325206912:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788869842.130149:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788869842.130163:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6d0576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d057d expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869842.130185:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6d0576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d057d expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869842.763024:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325207040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869842.763107:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869842.764529:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325207040 00000100:00100000:1.0:1788869842.764544:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325207040 00000100:00100000:1.0:1788869842.764637:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788869842.764650:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325207040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869842.764700:0:23407:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788869842.764778:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325207040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869842.764786:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788869842.764840:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325207040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869842.768385:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325207168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869842.768474:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869842.769299:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325207168 00000100:00100000:1.0:1788869842.769309:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325207168 00000100:00100000:1.0:1788869842.769364:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788869842.769373:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325207168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869842.769409:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788869842.773758:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325207168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4374us (5272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869842.773775:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788869842.778472:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325207168:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788869842.887667:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869843.913159:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788869844.615473:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788869844.934085:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788869845.835346:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869845.835352:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788869845.835355:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869845.835364:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788869845.835392:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869845.835396:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788869845.835398:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869845.835400:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788869845.835438:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325207552:0@lo:400:kworker.0 00000100:00100000:1.0:1788869845.835521:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869845.835559:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325208064:0@lo:400:kworker.0 00000100:00100000:1.0:1788869845.835626:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869845.835654:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869845.835660:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325207680:0@lo:400:kworker.0 00000100:00100000:1.0:1788869845.835687:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869845.838648:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325207296:0@lo:400:kworker.0 00000100:00100000:2.0:1788869845.840222:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869845.840313:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325207808:0@lo:400:kworker.0 00000100:00100000:2.0:1788869845.840353:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869845.840404:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788869845.840411:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325207424:0@lo:400:kworker.0 00000100:00100000:2.0:1788869845.840436:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869845.840456:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325207936:0@lo:400:kworker.0 00000100:00100000:2.0:1788869845.840480:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869845.840537:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325207552 00000100:00100000:2.0:1788869845.840544:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325207552 00000100:00100000:2.0:1788869845.840579:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325208064 00000100:00100000:2.0:1788869845.840582:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325208064 00000100:00100000:2.0:1788869845.840637:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325207808 00000100:00100000:2.0:1788869845.840641:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325207808 00000100:00100000:2.0:1788869845.840651:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325207936 00000100:00100000:2.0:1788869845.840653:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325207936 00000100:00100000:2.0:1788869845.840670:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788869845.840678:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325207552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869845.840739:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325207552:12345-0@lo:400:kworker.0 Request processed in 61us (5217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869845.840746:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788869845.840764:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869845.840771:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325208064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869845.840802:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325208064:12345-0@lo:400:kworker.0 Request processed in 33us (5216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869845.840809:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869845.840820:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869845.840825:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325207808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869845.840857:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325207808:12345-0@lo:400:kworker.0 Request processed in 32us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869845.840863:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869845.840883:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788869845.840889:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325207936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869845.840919:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325207936:12345-0@lo:400:kworker.0 Request processed in 31us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869845.840924:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788869845.840946:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325207680 00000100:00100000:2.0:1788869845.840949:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325207680 00000100:00100000:2.0:1788869845.840971:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325207424 00000100:00100000:2.0:1788869845.840973:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325207424 00000100:00100000:2.0:1788869845.840984:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788869845.840990:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325207680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869845.841023:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325207680:12345-0@lo:400:kworker.0 Request processed in 33us (5336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869845.841029:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788869845.841039:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788869845.841044:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325207424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869845.841069:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325207424:12345-0@lo:400:kworker.0 Request processed in 25us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869845.841075:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788869845.841117:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325207680:0@lo:400:kworker.0 00010000:00080000:2.0:1788869845.841131:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27038eb480 x1875765325207552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869845.841142:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325207552:0@lo:400:kworker.0 00010000:00080000:2.0:1788869845.841157:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27038eb100 x1875765325208064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869845.841178:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325208064:0@lo:400:kworker.0 00000100:00100000:2.0:1788869845.841214:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325207424:0@lo:400:kworker.0 00010000:00080000:2.0:1788869845.841224:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27038e8a80 x1875765325207936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869845.841231:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325207936:0@lo:400:kworker.0 00010000:00080000:2.0:1788869845.841239:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27038e9880 x1875765325207808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869845.841246:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325207808:0@lo:400:kworker.0 00000100:00100000:0.0:1788869845.841624:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325207296 00000100:00100000:0.0:1788869845.841631:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325207296 00000100:00100000:0.0:1788869845.841669:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788869845.841676:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:3650:x1875765325207296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869845.841723:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:3650:x1875765325207296:12345-0@lo:400:kworker.0 Request processed in 48us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869845.841729:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788869845.841782:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325207296:0@lo:400:kworker.0 00000100:00080000:3.0:1788869845.842184:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788869845.842191:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788869845.967277:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869846.731032:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869831/real 1788869831] req@ffff8e282f045c00 x1875765325200512/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869846 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869846.731072:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e282f045c00 x1875765325200512/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869846 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869846.731082:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869831/real 1788869831] req@ffff8e282f046300 x1875765325200640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869846 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869846.731093:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e282f046300 x1875765325200640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869846 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788869846.731177:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282d8c8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869846.731199:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788869846.731203:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325200512:0@lo:8:kworker.0 00000100:00080000:2.0:1788869846.731209:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e27029d0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869846.731221:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788869846.731223:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325200640:0@lo:8:kworker.0 00000100:00080000:1.0:1788869846.731377:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869846.731381:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788869846.731384:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869846.731387:0:23440:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788869846.731398:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869846.731401:0:23440:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788869846.731403:0:23440:0:(import.c:65:import_set_state_nolock()) ffff8e282d8c8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869846.731407:0:23440:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 765 00000100:00080000:1.0:1788869846.731413:0:23440:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788869846.731422:0:23440:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8e282d8c8000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869846.731450:0:23440:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27038e8700 x1875765325208704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788869846.731459:0:23440:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869846.731462:0:23440:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788869846.731464:0:23440:0:(import.c:65:import_set_state_nolock()) ffff8e27029d0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869846.731466:0:23440:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 765 00000100:00080000:1.0:1788869846.731469:0:23440:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788869846.731473:0:23440:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e27029d0800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869846.731504:0:23440:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27038eb100 x1875765325208832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869846.731566:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3649:1875765325208192:0@lo:400:kworker.0 00000100:00100000:1.0:1788869846.731655:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869846.731707:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325208960:0@lo:400:kworker.0 00000100:00100000:1.0:1788869846.731734:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869846.731755:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869846.731760:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325208576:0@lo:400:kworker.0 00000100:00100000:1.0:1788869846.731782:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869846.731810:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325208320:0@lo:400:kworker.0 00000100:00100000:1.0:1788869846.731831:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869846.731849:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325209088:0@lo:400:kworker.0 00000100:00100000:1.0:1788869846.731874:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869846.731900:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788869846.731907:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325208448:0@lo:400:kworker.0 00000100:00100000:1.0:1788869846.731928:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869846.731941:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325208192 00000100:00100000:0.0:1788869846.731950:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325208192 00000100:00100000:1.0:1788869846.731953:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702a62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325209216:0@lo:400:kworker.0 00000100:00100000:1.0:1788869846.731972:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869846.731996:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788869846.732004:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325208960 00000100:00100000:0.0:1788869846.732006:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:3649:x1875765325208192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869846.732007:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325208960 00000100:00100000:1.0:1788869846.732031:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325209088 00000100:00100000:1.0:1788869846.732034:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325209088 00000100:00100000:1.0:1788869846.732045:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325208448 00000100:00100000:1.0:1788869846.732047:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325208448 00000100:00100000:1.0:1788869846.732060:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325209216 00000100:00100000:1.0:1788869846.732063:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325209216 00000100:00100000:0.0:1788869846.732064:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:3649:x1875765325208192:12345-0@lo:400:kworker.0 Request processed in 61us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869846.732072:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788869846.732074:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869846.732079:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325208960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.732122:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3649:1875765325208192:0@lo:400:kworker.0 00010000:00080000:0.0:1788869846.732134:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27038eb480 x1875765325208960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869846.732143:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325208960:0@lo:400:kworker.0 00000100:00100000:2.0:1788869846.732449:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325208704:0@lo:8:kworker.0 00000100:00100000:1.0:1788869846.732882:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325208960:12345-0@lo:400:kworker.0 Request processed in 800us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869846.732891:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788869846.732909:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788869846.732916:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325209088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.735706:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788869846.735727:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325208448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869846.739954:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869846.740041:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325208832:0@lo:8:kworker.0 00000100:00100000:2.0:1788869846.740097:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869846.741431:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325208576 00000100:00100000:2.0:1788869846.741446:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325208576 00000100:00100000:2.0:1788869846.741510:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325208320 00000100:00100000:2.0:1788869846.741514:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325208320 00000100:00100000:2.0:1788869846.741533:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788869846.741541:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702a63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325208576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869846.741651:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702a63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325208576:12345-0@lo:400:kworker.0 Request processed in 110us (9867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869846.741659:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788869846.741676:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788869846.741683:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325208320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869846.741742:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325208320:12345-0@lo:400:kworker.0 Request processed in 59us (9909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869846.741748:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788869846.744407:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325208320:0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.744410:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325208704 00000100:00100000:0.0:1788869846.744422:0:24174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325208704 00000100:00100000:1.0:1788869846.744449:0:22665:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788869846.744458:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325208832 00000100:00100000:1.0:1788869846.744459:0:22665:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788869846.744464:0:24174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325208832 00000100:00100000:1.0:1788869846.744495:0:22664:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788869846.744507:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788869846.744519:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325209216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869846.744625:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325209216:12345-0@lo:400:kworker.0 Request processed in 110us (12651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869846.744633:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788869846.744728:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869846.744737:0:24174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875765325208704:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788869846.744742:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2702a62680 x1875765325209216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869846.744753:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702a62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325209216:0@lo:400:kworker.0 00010000:00080000:0.0:1788869846.744764:0:24174:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 780 last 0 00010000:00080000:2.0:1788869846.744770:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27038e8000 x1875765325209088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869846.744774:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325209088:12345-0@lo:400:kworker.0 Request processed in 11857us (12896us total) trans 0 rc 0/0 00000020:00000080:0.0:1788869846.744793:0:24174:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6d0584 00000100:00100000:2.0:1788869846.744801:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325209088:0@lo:400:kworker.0 00000100:00100000:1.0:1788869846.744809:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00002000:00100000:0.0:1788869846.744809:0:24174:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8e2827a94800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788869846.744817:0:24174:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788869846.744825:0:24174:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788869846.744996:0:24174:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788869846.745020:0:24174:0:(import.c:65:import_set_state_nolock()) ffff8e2827a97000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869846.745024:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325208576:0@lo:400:kworker.0 00000100:00100000:0.0:1788869846.745064:0:24174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765325208704:12345-0@lo:8:kworker.0 Request processed in 327us (5118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869846.745071:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788869846.745085:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788869846.745089:0:24174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875765325208832:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788869846.745101:0:24174:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788869846.748814:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325208448:12345-0@lo:400:kworker.0 Request processed in 13083us (16872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869846.748835:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788869846.751138:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27038e9880 x1875765325208448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869846.751159:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325208448:0@lo:400:kworker.0 00010000:00080000:2.0:1788869846.751662:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27038e8700 x1875765325208704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869846.751673:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788869846.751682:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788869846.751703:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788869846.751710:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788869846.751714:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e282d8c8000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788869846.751739:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788869846.751746:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325208704:0@lo:8:kworker.0 00000004:00080000:2.0:1788869846.751759:0:23406:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788869846.751867:0:23406:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 780665279356ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788869846.751873:0:23406:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788869846.752331:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325209344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869846.752404:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869846.752563:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325209344 00000100:00100000:1.0:1788869846.752571:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325209344 00000100:00100000:1.0:1788869846.752634:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869846.752645:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875765325209344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869846.752676:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000004:00080000:3.0:1788869846.752764:0:23408:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788869846.752789:0:23408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23408:1875765325209472:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788869846.752822:0:23408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869846.752840:0:23408:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840fcaf00 going to sleep for 11 seconds 00000100:00080000:3.0:1788869846.752853:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869846.752871:0:24175:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788869846.752878:0:24175:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788869846.752988:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325209472 00000100:00100000:3.0:1788869846.752992:0:24175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325209472 00000100:00100000:3.0:1788869846.753092:0:24507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869846.753099:0:24507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:23408:x1875765325209472:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788869846.754549:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1875765325209344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1898us (2136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869846.754564:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788869846.759818:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2827a5f480 x1875765325209344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869846.759845:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325209344:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1788869846.766211:0:23398:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1788869846.769419:0:24507:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788869846.769432:0:24507:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788869846.769558:0:24507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23408:x1875765325209472:12345-0@lo:7:osp-pre-0-1.0 Request processed in 16453us (16728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869846.769570:0:24507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788869846.769696:0:23408:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2827a5d500 x1875765325209472/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788869862 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869846.769732:0:23408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23408:1875765325209472:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788869846.769749:0:23408:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788869846.769795:0:23408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23408:1875765325209600:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788869846.769832:0:23408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869846.769878:0:23408:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a30600 going to sleep for 11 seconds 00000100:00100000:1.0:1788869846.770530:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325209600 00000100:00100000:1.0:1788869846.770540:0:24175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325209600 00000100:00100000:1.0:1788869846.770614:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788869846.770624:0:24175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23408:x1875765325209600:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788869846.770656:0:24175:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788869846.770703:0:24175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23408:x1875765325209600:12345-0@lo:5:osp-pre-0-1.0 Request processed in 81us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869846.770709:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788869846.771025:0:23408:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703a31180 x1875765325209600/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869862 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869846.771038:0:23408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23408:1875765325209600:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788869846.771052:0:23408:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788869846.771088:0:23408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23408:1875765325209728:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788869846.771332:0:23408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869846.771407:0:23408:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2702a30600 going to sleep for 11 seconds 00000100:00100000:1.0:1788869846.782236:0:24507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325209728 00000100:00100000:1.0:1788869846.782263:0:24507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325209728 00000100:00100000:1.0:1788869846.782328:0:24507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788869846.782340:0:24507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23408:x1875765325209728:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788869846.782393:0:24507:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:1.0:1788869846.809422:0:24174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875765325208832:12345-0@lo:8:kworker.0 Request processed in 64321us (69314us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788869846.809438:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788869846.810561:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e27029d0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869846.810570:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788869846.810575:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325208832:0@lo:8:kworker.0 00000001:00080000:0.0:1788869846.866662:0:24170:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1788869846.866679:0:24170:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788869846.866919:0:24507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23408:x1875765325209728:12345-0@lo:5:osp-pre-0-1.0 Request processed in 84577us (95582us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788869846.866933:0:24507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788869846.870392:0:23408:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703a31180 x1875765325209728/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869862 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869846.870408:0:23408:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788869846.870422:0:23408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23408:1875765325209728:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788869846.870440:0:23408:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1788869846.870509:0:23408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23408:1875765325209856:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788869846.870573:0:23408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869846.870640:0:23408:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840fcaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869846.871424:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325209856 00000100:00100000:2.0:1788869846.871434:0:22676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325209856 00000100:00100000:2.0:1788869846.871497:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788869846.871507:0:22676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23408:x1875765325209856:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788869846.871629:0:22676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23408:x1875765325209856:12345-0@lo:900:osp-pre-0-1.0 Request processed in 123us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869846.871649:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788869846.872239:0:23408:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2827a5f100 x1875765325209856/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788869862 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869846.872254:0:23408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23408:1875765325209856:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1788869846.981797:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869847.198783:0:24541:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1788869847.566033:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788869847.877942:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325209984:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869847.878026:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869847.878667:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325209984 00000100:00100000:0.0:1788869847.878681:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325209984 00000100:00100000:3.0:1788869847.878854:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325210112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869847.878903:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869847.878981:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325210112 00000100:00100000:1.0:1788869847.878986:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788869847.878986:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325210112 00000100:00100000:1.0:1788869847.878997:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325209984:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869847.879000:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788869847.879006:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325210112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869847.879030:0:23407:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000004:00000024:0.0:1788869847.879042:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788869847.879084:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325209984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869847.879091:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788869847.879142:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325209984:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869847.880042:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325210112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869847.880042:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325210112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1024us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869847.880051:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1788869848.007266:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788869848.250413:0:24593:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869848.250873:0:24593:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788869849.037653:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788869849.209704:0:24643:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869849.210071:0:24643:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788869850.054223:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869850.821724:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869830/real 1788869830] req@ffff8e2827a5ca80 x1875765325198976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869850 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869850.821761:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e2827a5ca80 x1875765325198976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869850 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869850.821771:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788869830/real 1788869830] req@ffff8e2827a5fb80 x1875765325199104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869850 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869850.821784:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e2827a5fb80 x1875765325199104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788869850 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788869850.821803:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2703a18000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869850.821831:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788869850.821835:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325198976:0@lo:8:kworker.0 00000100:00080000:2.0:1788869850.821849:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2829c0c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869850.821859:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788869850.821862:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325199104:0@lo:8:kworker.0 00000100:00080000:0.0:1788869850.822046:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869850.822051:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788869850.822057:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e2703a18000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869850.822061:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 764 00000100:00080000:0.0:1788869850.822066:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788869850.822080:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e2703a18000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869850.822107:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282f044a80 x1875765325210496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869850.822121:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869850.822125:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788869850.822126:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e2829c0c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869850.822129:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 764 00000100:00080000:0.0:1788869850.822135:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788869850.822139:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e2829c0c000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869850.822151:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282f045f80 x1875765325210624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869850.822177:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3651:1875765325210240:0@lo:400:kworker.0 00000100:00080000:0.0:1788869850.822217:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869850.822220:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788869850.822222:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e27029d0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869850.822226:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 780 00000100:00080000:0.0:1788869850.822228:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788869850.822233:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e27029d0800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869850.822240:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869850.822244:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e27038e9880 x1875765325211136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869850.822294:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325211008:0@lo:400:kworker.0 00000100:00100000:0.0:1788869850.822307:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325210752:0@lo:400:kworker.0 00000100:00100000:1.0:1788869850.822324:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869850.822342:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869850.822345:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788869850.822350:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325210880:0@lo:400:kworker.0 00000100:00100000:0.0:1788869850.822360:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325211392:0@lo:400:kworker.0 00000100:00100000:1.0:1788869850.822371:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869850.822392:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869850.822400:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325211520:0@lo:400:kworker.0 00000100:00100000:0.0:1788869850.822407:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788869850.822412:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325210368:0@lo:400:kworker.0 00000100:00100000:1.0:1788869850.822419:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869850.822431:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869850.822446:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325210240 00000100:00100000:0.0:1788869850.822446:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325211264:0@lo:400:kworker.0 00000100:00100000:1.0:1788869850.822453:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325210240 00000100:00100000:0.0:1788869850.822487:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869850.822506:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788869850.822515:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:3651:x1875765325210240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869850.822566:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:3651:x1875765325210240:12345-0@lo:400:kworker.0 Request processed in 53us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869850.822574:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788869850.822634:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325211008 00000100:00100000:1.0:1788869850.822638:0:24176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325211008 00000100:00100000:1.0:1788869850.822673:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869850.822681:0:24176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702a60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325211008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869850.822706:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325210880 00000100:00100000:1.0:1788869850.822712:0:24176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702a60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325211008:12345-0@lo:400:kworker.0 Request processed in 33us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869850.822715:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325210880 00000100:00100000:1.0:1788869850.822718:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788869850.822734:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325210752 00000100:00100000:1.0:1788869850.822737:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325210752 00000100:00100000:0.0:1788869850.822747:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325210368 00000100:00100000:0.0:1788869850.822750:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325210368 00000100:00100000:1.0:1788869850.822756:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325211392 00000100:00100000:1.0:1788869850.822758:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325211392 00000100:00100000:0.0:1788869850.822769:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788869850.822771:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325211520 00000100:00100000:1.0:1788869850.822772:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325211520 00000100:00100000:0.0:1788869850.822778:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702a61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325210880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869850.822782:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325211264 00000100:00100000:1.0:1788869850.822784:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325211264 00000100:00100000:1.0:1788869850.822795:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788869850.822800:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325210752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869850.822815:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702a61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325210880:12345-0@lo:400:kworker.0 Request processed in 37us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869850.822821:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788869850.822827:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325210752:12345-0@lo:400:kworker.0 Request processed in 27us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869850.822833:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788869850.822833:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788869850.822838:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325210368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869850.822842:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788869850.822846:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325211392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869850.822862:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325210368:12345-0@lo:400:kworker.0 Request processed in 24us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869850.822866:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325211392:12345-0@lo:400:kworker.0 Request processed in 20us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869850.822868:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788869850.822876:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788869850.822887:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788869850.822892:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325211520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869850.822918:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325211520:12345-0@lo:400:kworker.0 Request processed in 26us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869850.822923:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788869850.822927:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325210368:0@lo:400:kworker.0 00000100:00100000:1.0:1788869850.822933:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788869850.822937:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282f044e00 x1875765325210752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869850.822938:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325211264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869850.822946:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325210752:0@lo:400:kworker.0 00000100:00100000:1.0:1788869850.822961:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325211264:12345-0@lo:400:kworker.0 Request processed in 24us (475us total) trans 0 rc 0/0 00010000:00080000:0.0:1788869850.822962:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27038e8000 x1875765325211392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869850.822967:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869850.822971:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325211392:0@lo:400:kworker.0 00000100:00080000:1.0:1788869850.822996:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869850.823000:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869850.823002:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869850.823027:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325210880:0@lo:400:kworker.0 00010000:00080000:1.0:1788869850.823036:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27038e9180 x1875765325211520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869850.823044:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325211520:0@lo:400:kworker.0 00010000:00080000:1.0:1788869850.823053:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27038e8700 x1875765325211008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788869866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869850.823061:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325211008:0@lo:400:kworker.0 00000100:00100000:1.0:1788869850.823069:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3651:1875765325210240:0@lo:400:kworker.0 00000100:00100000:2.0:1788869850.823122:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325210496:0@lo:8:kworker.0 00000100:00100000:2.0:1788869850.823154:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869850.823207:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325210624:0@lo:8:kworker.0 00000100:00100000:1.0:1788869850.823214:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325210496 00000100:00100000:1.0:1788869850.823223:0:24174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325210496 00000100:00100000:2.0:1788869850.823228:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788869850.823305:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e27038e8a80 x1875765325211264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869850.823314:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325211264:0@lo:400:kworker.0 00000100:00100000:2.0:1788869850.830778:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325211136:0@lo:8:kworker.0 00000100:00100000:2.0:1788869850.830863:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869850.833672:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325210624 00000100:00100000:1.0:1788869850.833694:0:24174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325210624 00000100:00100000:1.0:1788869850.833774:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869850.833784:0:24174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875765325210496:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788869850.833826:0:24174:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 784 last 0 00000020:00000080:1.0:1788869850.833860:0:24174:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6d058b 00000100:00100000:3.0:1788869850.835104:0:24507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869850.835115:0:24507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875765325210624:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788869850.835152:0:24507:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788869850.835238:0:24507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875765325210624:12345-0@lo:8:kworker.0 Request processed in 122us (12007us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788869850.835245:0:24507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00002000:00100000:1.0:1788869850.836996:0:24174:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e2704043800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788869850.837001:0:24174:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788869850.837004:0:24174:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788869850.837102:0:24174:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788869850.837214:0:24174:0:(import.c:65:import_set_state_nolock()) ffff8e2704046800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869850.837295:0:24174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765325210496:12345-0@lo:8:kworker.0 Request processed in 3511us (14138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869850.837306:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788869850.840964:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e282f044a80 x1875765325210496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869850.840981:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788869850.840995:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788869850.841008:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788869850.841016:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788869850.841019:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2703a18000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788869850.841042:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788869850.841048:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325210496:0@lo:8:kworker.0 00000004:00080000:2.0:1788869850.841063:0:22688:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788869850.841181:0:22688:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 784754593667ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788869850.841188:0:22688:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:2.0:1788869850.841248:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2829c0c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869850.841252:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788869850.841256:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325210624:0@lo:8:kworker.0 00000004:00080000:2.0:1788869850.842964:0:22689:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:2.0:1788869850.843010:0:22689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22689:1875765325211776:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788869850.843099:0:22689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869850.843145:0:22689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e27039276c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869850.844616:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325211648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869850.844692:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869850.844756:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325211136 00000100:00100000:1.0:1788869850.844818:0:24174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325211136 00000100:00100000:1.0:1788869850.844851:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325211776 00000100:00100000:1.0:1788869850.844854:0:24174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325211776 00000100:00100000:1.0:1788869850.844890:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788869850.844897:0:24174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875765325211136:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788869850.844922:0:24174:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788869850.844969:0:24174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875765325211136:12345-0@lo:8:kworker.0 Request processed in 71us (14106us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788869850.844977:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788869850.845002:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788869850.845009:0:24174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22689:x1875765325211776:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1788869850.845249:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869850.845276:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325211648 00000100:00100000:2.0:1788869850.845280:0:24178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325211648 00000100:00100000:2.0:1788869850.845305:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788869850.845312:0:24178:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702a61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875765325211648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869850.845330:0:24178:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788869850.845407:0:24178:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702a61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875765325211648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869850.845414:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788869850.845440:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2703a33480 x1875765325211648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788869850.845442:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e27029d0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869850.845447:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788869850.845450:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325211136:0@lo:8:kworker.0 00000100:00100000:1.0:1788869850.845456:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325211648:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1788869850.849396:0:24174:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788869850.849412:0:24174:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1788869850.849419:0:24174:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000004:00080000:2.0:1788869850.849434:0:22644:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788869850.863421:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869850.863434:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b58f5b17/0x4c16c38a9b6d0592 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.863452:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=784s v=(0 0) 00010000:00010000:1.0:1788869850.863457:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869850.863464:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b58f5b17/0x4c16c38a9b6d0592 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.863481:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b58f5b17/0x4c16c38a9b6d0592 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.863491:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b58f5b17/0x4c16c38a9b6d0592 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.863500:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b58f5b17/0x4c16c38a9b6d0592 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.863532:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788869850.864339:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869850.864346:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000651ffc74/0x4c16c38a9b6d0599 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.864357:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=784s v=(0 0) 00010000:00010000:1.0:1788869850.864361:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869850.864366:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000651ffc74/0x4c16c38a9b6d0599 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.864387:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000651ffc74/0x4c16c38a9b6d0599 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.864397:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000651ffc74/0x4c16c38a9b6d0599 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.864404:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000651ffc74/0x4c16c38a9b6d0599 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.864430:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788869850.864662:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869850.864671:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b58f5b17/0x4c16c38a9b6d0592 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.864679:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869850.864684:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b58f5b17/0x4c16c38a9b6d0592 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.864694:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b58f5b17/0x4c16c38a9b6d0592 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.864714:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b58f5b17/0x4c16c38a9b6d0592 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.864721:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b58f5b17/0x4c16c38a9b6d0592 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.864744:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869850.864748:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000651ffc74/0x4c16c38a9b6d0599 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.864761:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edaa00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869850.864763:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000651ffc74/0x4c16c38a9b6d0599 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.864770:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000651ffc74/0x4c16c38a9b6d0599 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.864780:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000651ffc74/0x4c16c38a9b6d0599 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.864787:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000651ffc74/0x4c16c38a9b6d0599 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.864800:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.864802:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.864803:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869850.864852:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788869850.865003:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869850.865009:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f84fcb1/0x4c16c38a9b6d05a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.865018:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=784s v=(0 0) 00010000:00010000:1.0:1788869850.865026:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869850.865031:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f84fcb1/0x4c16c38a9b6d05a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.865040:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f84fcb1/0x4c16c38a9b6d05a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.865048:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f84fcb1/0x4c16c38a9b6d05a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.865054:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f84fcb1/0x4c16c38a9b6d05a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.865074:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869850.865281:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869850.865287:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f84fcb1/0x4c16c38a9b6d05a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.865294:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869850.865298:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f84fcb1/0x4c16c38a9b6d05a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.865306:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f84fcb1/0x4c16c38a9b6d05a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.865324:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f84fcb1/0x4c16c38a9b6d05a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.865331:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f84fcb1/0x4c16c38a9b6d05a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.865345:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.865347:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.865349:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788869850.866873:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869850.866889:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6d05a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.866904:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=784s v=(0 0) 00010000:00010000:1.0:1788869850.866908:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869850.866914:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6d05a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.866927:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6d05a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.866937:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6d05a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.866969:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6d05a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.866991:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869850.867261:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869850.867269:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6d05a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.867288:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edbc00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869850.867292:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6d05a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.867301:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6d05a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.867319:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6d05a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.867327:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6d05a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.867346:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869850.867348:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869850.867349:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788869850.869362:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869850.869389:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000feda5b1/0x4c16c38a9b6d05ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.869405:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=784s v=(0 0) 00010000:00010000:1.0:1788869850.869410:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869850.869416:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000feda5b1/0x4c16c38a9b6d05ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.869430:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000feda5b1/0x4c16c38a9b6d05ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.869440:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000feda5b1/0x4c16c38a9b6d05ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.869448:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000feda5b1/0x4c16c38a9b6d05ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.869511:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788869850.870912:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869850.870925:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005203b1be/0x4c16c38a9b6d05b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.870954:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=784s v=(0 0) 00010000:00010000:1.0:1788869850.870976:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869850.870983:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005203b1be/0x4c16c38a9b6d05b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.870997:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005203b1be/0x4c16c38a9b6d05b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.871007:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005203b1be/0x4c16c38a9b6d05b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.871014:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005203b1be/0x4c16c38a9b6d05b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.873073:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869850.873087:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000feda5b1/0x4c16c38a9b6d05ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.873101:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869850.873106:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000feda5b1/0x4c16c38a9b6d05ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.873117:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000feda5b1/0x4c16c38a9b6d05ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.873221:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000feda5b1/0x4c16c38a9b6d05ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.873230:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000feda5b1/0x4c16c38a9b6d05ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.873275:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869850.873279:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005203b1be/0x4c16c38a9b6d05b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.873285:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edbe00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869850.873288:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005203b1be/0x4c16c38a9b6d05b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.873296:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005203b1be/0x4c16c38a9b6d05b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.873305:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005203b1be/0x4c16c38a9b6d05b5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.873314:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.873316:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.873318:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.873345:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869850.873356:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788869850.873365:0:24174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005203b1be/0x4c16c38a9b6d05b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788869850.876626:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869850.876643:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074aa52e7/0x4c16c38a9b6d05bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.876663:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=784s v=(0 0) 00010000:00010000:1.0:1788869850.876668:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869850.876675:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074aa52e7/0x4c16c38a9b6d05bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.876720:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074aa52e7/0x4c16c38a9b6d05bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.876733:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074aa52e7/0x4c16c38a9b6d05bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.876742:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074aa52e7/0x4c16c38a9b6d05bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.876765:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869850.876943:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869850.876952:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074aa52e7/0x4c16c38a9b6d05bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.876961:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edae00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869850.876966:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074aa52e7/0x4c16c38a9b6d05bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.876988:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074aa52e7/0x4c16c38a9b6d05bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.877006:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074aa52e7/0x4c16c38a9b6d05bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.877013:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074aa52e7/0x4c16c38a9b6d05bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.877033:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.877035:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.877037:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788869850.880096:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869850.880111:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6d05c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.880127:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=784s v=(0 0) 00010000:00010000:1.0:1788869850.880132:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869850.880138:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6d05c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.880153:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6d05c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.880164:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6d05c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.880191:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6d05c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.880216:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869850.880417:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869850.880425:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6d05c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.880433:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edbc00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869850.880438:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6d05c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.880448:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6d05c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.880467:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6d05c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.880487:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d91fba65/0x4c16c38a9b6d05c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.880506:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.880508:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.880510:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788869850.881734:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869850.881746:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f84fcb1/0x4c16c38a9b6d05ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.881762:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=784s v=(0 0) 00010000:00010000:1.0:1788869850.881766:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869850.881771:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f84fcb1/0x4c16c38a9b6d05ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.881784:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f84fcb1/0x4c16c38a9b6d05ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.881792:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f84fcb1/0x4c16c38a9b6d05ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.881800:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f84fcb1/0x4c16c38a9b6d05ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.881824:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869850.882038:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869850.882044:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f84fcb1/0x4c16c38a9b6d05ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.882051:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869850.882056:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f84fcb1/0x4c16c38a9b6d05ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.882066:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f84fcb1/0x4c16c38a9b6d05ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.882081:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f84fcb1/0x4c16c38a9b6d05ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.882087:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f84fcb1/0x4c16c38a9b6d05ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.882106:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.882108:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.882109:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788869850.882293:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869850.882299:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000651ffc74/0x4c16c38a9b6d05d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.882313:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=784s v=(0 0) 00010000:00010000:1.0:1788869850.882316:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869850.882320:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000651ffc74/0x4c16c38a9b6d05d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.882329:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000651ffc74/0x4c16c38a9b6d05d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.882337:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000651ffc74/0x4c16c38a9b6d05d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.882344:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000651ffc74/0x4c16c38a9b6d05d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.882364:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869850.882404:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869850.882409:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000651ffc74/0x4c16c38a9b6d05d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.882417:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edaa00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869850.882421:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000651ffc74/0x4c16c38a9b6d05d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.882428:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000651ffc74/0x4c16c38a9b6d05d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.882439:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000651ffc74/0x4c16c38a9b6d05d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.882446:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000651ffc74/0x4c16c38a9b6d05d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.882460:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.882462:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.882464:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869850.883048:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869850.883055:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d05d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.883064:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=784s v=(0 0) 00010000:00010000:0.0:1788869850.883068:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869850.883072:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d05d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.883096:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d05d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.883104:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d05d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.883111:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d05d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.883141:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869850.883365:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869850.883371:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d05d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.883389:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4c00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869850.883393:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d05d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.883401:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d05d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.883421:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d05d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.883428:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d05d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.883444:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869850.883445:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869850.883447:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869850.885197:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869850.885211:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d05df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.885226:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=784s v=(0 0) 00010000:00010000:0.0:1788869850.885230:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869850.885235:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d05df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.885247:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d05df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.885257:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d05df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.885282:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d05df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.885311:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869850.886672:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869850.886683:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d05df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.886696:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869850.886701:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d05df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.886712:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d05df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.886755:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d05df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.886764:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a58032c/0x4c16c38a9b6d05df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.886790:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869850.886792:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869850.886793:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869850.887252:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869850.887262:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2c92771/0x4c16c38a9b6d05e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.887273:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=784s v=(0 0) 00010000:00010000:0.0:1788869850.887278:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869850.887283:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2c92771/0x4c16c38a9b6d05e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.887293:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2c92771/0x4c16c38a9b6d05e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.887301:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2c92771/0x4c16c38a9b6d05e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.887310:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2c92771/0x4c16c38a9b6d05e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.887368:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788869850.889447:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869850.889459:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002593f83/0x4c16c38a9b6d05ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.889492:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=784s v=(0 0) 00010000:00010000:0.0:1788869850.889496:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869850.889502:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002593f83/0x4c16c38a9b6d05ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.889516:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002593f83/0x4c16c38a9b6d05ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.889526:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002593f83/0x4c16c38a9b6d05ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.889533:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002593f83/0x4c16c38a9b6d05ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.889610:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869850.889620:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2c92771/0x4c16c38a9b6d05e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.889628:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869850.889633:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2c92771/0x4c16c38a9b6d05e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.889643:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2c92771/0x4c16c38a9b6d05e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.889661:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2c92771/0x4c16c38a9b6d05e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.889669:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2c92771/0x4c16c38a9b6d05e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.889699:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869850.889702:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002593f83/0x4c16c38a9b6d05ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.889709:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4000 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869850.889712:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002593f83/0x4c16c38a9b6d05ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.889720:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002593f83/0x4c16c38a9b6d05ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.889729:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002593f83/0x4c16c38a9b6d05ed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.889736:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869850.889738:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869850.889740:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869850.892370:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.892982:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788869850.892996:0:24174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002593f83/0x4c16c38a9b6d05ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869850.895801:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869850.895818:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000021e8156/0x4c16c38a9b6d05f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.895837:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=784s v=(0 0) 00010000:00010000:0.0:1788869850.896067:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869850.896076:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000021e8156/0x4c16c38a9b6d05f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.896117:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000021e8156/0x4c16c38a9b6d05f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.896128:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000021e8156/0x4c16c38a9b6d05f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.896137:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000021e8156/0x4c16c38a9b6d05f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.896163:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869850.896229:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869850.896237:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000021e8156/0x4c16c38a9b6d05f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.896245:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4e00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869850.896250:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000021e8156/0x4c16c38a9b6d05f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.896270:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000021e8156/0x4c16c38a9b6d05f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.896290:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000021e8156/0x4c16c38a9b6d05f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.896297:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000021e8156/0x4c16c38a9b6d05f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.896319:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869850.896320:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869850.896322:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869850.897543:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869850.897556:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036133ecb/0x4c16c38a9b6d05fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.897571:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=784s v=(0 0) 00010000:00010000:2.0:1788869850.897575:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869850.897580:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036133ecb/0x4c16c38a9b6d05fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.897622:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036133ecb/0x4c16c38a9b6d05fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.897632:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036133ecb/0x4c16c38a9b6d05fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.897640:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036133ecb/0x4c16c38a9b6d05fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.897663:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869850.897910:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869850.897917:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036133ecb/0x4c16c38a9b6d05fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.897925:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842042600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869850.897930:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036133ecb/0x4c16c38a9b6d05fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.897939:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036133ecb/0x4c16c38a9b6d05fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.897961:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036133ecb/0x4c16c38a9b6d05fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.897969:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036133ecb/0x4c16c38a9b6d05fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.897998:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869850.898000:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869850.898002:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869850.899027:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869850.899046:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d90752c/0x4c16c38a9b6d0602 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.899059:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=784s v=(0 0) 00010000:00010000:2.0:1788869850.899063:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869850.899068:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d90752c/0x4c16c38a9b6d0602 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.899080:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d90752c/0x4c16c38a9b6d0602 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.899089:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d90752c/0x4c16c38a9b6d0602 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.899097:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d90752c/0x4c16c38a9b6d0602 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.899237:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788869850.900707:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869850.900721:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d0609 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.900735:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=784s v=(0 0) 00010000:00010000:2.0:1788869850.900739:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869850.900744:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d0609 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.900757:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d0609 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.900778:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d0609 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.900785:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d0609 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.902714:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869850.902728:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d90752c/0x4c16c38a9b6d0602 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.902742:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842042a00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869850.902746:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d90752c/0x4c16c38a9b6d0602 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.902757:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d90752c/0x4c16c38a9b6d0602 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.902778:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d90752c/0x4c16c38a9b6d0602 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.902807:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d90752c/0x4c16c38a9b6d0602 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.902835:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869850.902839:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d0609 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.902846:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6a00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869850.902849:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d0609 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.902857:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d0609 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.903351:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d0609 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.903362:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869850.903363:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869850.903366:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869850.903440:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788869850.903451:0:24174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d0609 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869850.903604:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869850.906461:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869850.906480:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a7aad0e/0x4c16c38a9b6d0610 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.906497:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=784s v=(0 0) 00010000:00010000:2.0:1788869850.906502:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869850.906509:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a7aad0e/0x4c16c38a9b6d0610 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.906525:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a7aad0e/0x4c16c38a9b6d0610 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.906536:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a7aad0e/0x4c16c38a9b6d0610 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.906565:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a7aad0e/0x4c16c38a9b6d0610 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.906717:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788869850.909152:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869850.909170:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6d0617 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.909190:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=784s v=(0 0) 00010000:00010000:2.0:1788869850.909195:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869850.909203:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6d0617 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.909217:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6d0617 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.909228:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6d0617 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.909235:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6d0617 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.909518:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869850.909527:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a7aad0e/0x4c16c38a9b6d0610 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.909536:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d7400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869850.909555:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a7aad0e/0x4c16c38a9b6d0610 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.909565:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a7aad0e/0x4c16c38a9b6d0610 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.909583:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a7aad0e/0x4c16c38a9b6d0610 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.909607:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a7aad0e/0x4c16c38a9b6d0610 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.909628:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869850.909631:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6d0617 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.909638:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869850.909641:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6d0617 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.909647:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6d0617 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.909655:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6d0617 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869850.909663:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869850.909671:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869850.909673:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869850.912534:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788869850.912551:0:24174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6d0617 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788869850.916272:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869850.916287:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d061e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.916304:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=784s v=(0 0) 00010000:00010000:2.0:1788869850.916309:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869850.916316:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d061e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.916330:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d061e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.916341:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d061e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.916349:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d061e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.919426:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869850.919445:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d061e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.919460:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6a00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869850.919467:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d061e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.919479:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d061e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.919501:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d061e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.919647:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.919669:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.919671:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869850.922304:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788869850.922321:0:24174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d061e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788869850.923224:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869850.923245:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6d0625 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.923273:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=784s v=(0 0) 00010000:00010000:2.0:1788869850.923279:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869850.923285:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6d0625 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.923301:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6d0625 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.923312:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6d0625 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.923320:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6d0625 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.925092:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869850.925105:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6d0625 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.925117:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d7a00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869850.925121:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6d0625 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.925132:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6d0625 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.925153:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6d0625 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.925166:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.925167:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.925169:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869850.930999:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788869850.931016:0:24174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6d0625 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.931022:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869850.932017:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869850.932026:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac802f73/0x4c16c38a9b6d062c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.932040:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=784s v=(0 0) 00010000:00010000:2.0:1788869850.932045:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869850.932051:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac802f73/0x4c16c38a9b6d062c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.932079:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac802f73/0x4c16c38a9b6d062c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.932090:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac802f73/0x4c16c38a9b6d062c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.932098:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac802f73/0x4c16c38a9b6d062c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.932123:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869850.932424:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869850.932431:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac802f73/0x4c16c38a9b6d062c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.932439:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d7200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869850.932444:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac802f73/0x4c16c38a9b6d062c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.932463:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac802f73/0x4c16c38a9b6d062c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.932481:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac802f73/0x4c16c38a9b6d062c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.932489:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac802f73/0x4c16c38a9b6d062c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.932507:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.932509:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.932511:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869850.933694:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869850.933704:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6d0633 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.933717:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=784s v=(0 0) 00010000:00010000:2.0:1788869850.933722:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869850.933727:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6d0633 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.933739:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6d0633 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.933748:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6d0633 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.933766:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6d0633 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.933791:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869850.934417:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869850.934426:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6d0633 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.934437:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869850.934441:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6d0633 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.934450:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6d0633 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.934468:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6d0633 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.934489:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9940ff1/0x4c16c38a9b6d0633 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.934510:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.934512:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.934513:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869850.936677:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869850.936690:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d063a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.936707:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=784s v=(0 0) 00010000:00010000:2.0:1788869850.936712:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869850.936719:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d063a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.936733:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d063a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.936743:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d063a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.936751:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d063a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.936770:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788869850.937824:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869850.937834:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f65dd888/0x4c16c38a9b6d0641 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.937869:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=784s v=(0 0) 00010000:00010000:2.0:1788869850.937873:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869850.937878:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f65dd888/0x4c16c38a9b6d0641 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.937891:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f65dd888/0x4c16c38a9b6d0641 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.937901:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f65dd888/0x4c16c38a9b6d0641 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.937908:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f65dd888/0x4c16c38a9b6d0641 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.937924:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788869850.938649:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869850.938658:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6d0648 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.938668:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=784s v=(0 0) 00010000:00010000:2.0:1788869850.938672:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869850.938676:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6d0648 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.938687:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6d0648 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.938706:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6d0648 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.938714:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6d0648 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.938723:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788869850.939060:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788869850.939068:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d063a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.939077:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869850.939081:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d063a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.939089:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d063a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.939106:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d063a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.939112:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d063a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.939129:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869850.939132:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f65dd888/0x4c16c38a9b6d0641 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.939145:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d7e00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869850.939148:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f65dd888/0x4c16c38a9b6d0641 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.939155:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f65dd888/0x4c16c38a9b6d0641 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.939165:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f65dd888/0x4c16c38a9b6d0641 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.939172:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f65dd888/0x4c16c38a9b6d0641 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.939186:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869850.939189:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6d0648 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.939196:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d7000 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869850.939199:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6d0648 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.939206:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6d0648 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.939214:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6d0648 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.939227:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006cbe5a1/0x4c16c38a9b6d0648 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.939241:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.939243:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.939244:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869850.939251:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869850.939412:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869850.939418:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6d064f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.939427:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=784s v=(0 0) 00010000:00010000:2.0:1788869850.939430:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869850.939434:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6d064f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.939463:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6d064f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.939471:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6d064f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.939478:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6d064f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.939508:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788869850.940188:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869850.940197:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a9157c8/0x4c16c38a9b6d0656 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.940207:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=784s v=(0 0) 00010000:00010000:2.0:1788869850.940210:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869850.940215:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a9157c8/0x4c16c38a9b6d0656 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.940224:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a9157c8/0x4c16c38a9b6d0656 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.940348:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a9157c8/0x4c16c38a9b6d0656 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.940357:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a9157c8/0x4c16c38a9b6d0656 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.940383:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788869850.941718:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869850.941728:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6d064f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.941738:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869850.941756:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6d064f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.941767:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6d064f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.941785:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6d064f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.941793:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a310777/0x4c16c38a9b6d064f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.941816:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869850.941819:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a9157c8/0x4c16c38a9b6d0656 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.941824:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6800 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869850.941828:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a9157c8/0x4c16c38a9b6d0656 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.941836:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a9157c8/0x4c16c38a9b6d0656 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.941853:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a9157c8/0x4c16c38a9b6d0656 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.941859:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a9157c8/0x4c16c38a9b6d0656 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.941876:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869850.941878:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869850.941880:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869850.941887:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869850.942006:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869850.942013:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6d065d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.942022:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=784s v=(0 0) 00010000:00010000:2.0:1788869850.942026:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869850.942031:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6d065d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.942042:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6d065d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.942051:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6d065d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.942059:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6d065d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.942074:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788869850.942081:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869850.942084:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6d065d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.942101:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6e00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869850.942104:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6d065d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.942112:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6d065d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.942121:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6d065d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.942830:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6d065d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.942847:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869850.942848:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869850.942850:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869850.944140:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869850.944151:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002593f83/0x4c16c38a9b6d0664 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.944164:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=784s v=(0 0) 00010000:00010000:0.0:1788869850.944168:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869850.944174:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002593f83/0x4c16c38a9b6d0664 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.944187:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002593f83/0x4c16c38a9b6d0664 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.944197:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002593f83/0x4c16c38a9b6d0664 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.944204:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002593f83/0x4c16c38a9b6d0664 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869850.944223:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788869850.944296:0:24174:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:0.0:1788869850.944488:0:24174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22689:x1875765325211776:12345-0@lo:5:osp-pre-0-0.0 Request processed in 99475us (101384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869850.944498:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788869850.944885:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869850.944892:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002593f83/0x4c16c38a9b6d0664 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.944901:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4000 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869850.944905:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002593f83/0x4c16c38a9b6d0664 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.944914:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002593f83/0x4c16c38a9b6d0664 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.944939:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002593f83/0x4c16c38a9b6d0664 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.944946:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002593f83/0x4c16c38a9b6d0664 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869850.944963:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869850.944965:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869850.944967:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869850.945270:0:22689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22689:1875765325211776:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788869850.945286:0:22689:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:1.0:1788869850.945336:0:22689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702a63b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22689:1875765325211904:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788869850.945391:0:22689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869850.945427:0:22689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0ca240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869850.946157:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325211904 00000100:00100000:2.0:1788869850.946167:0:24175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325211904 00000100:00100000:2.0:1788869850.946292:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788869850.946303:0:24175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702a61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22689:x1875765325211904:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788869850.946343:0:24175:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:3.0:1788869850.960405:0:24170:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1788869850.960570:0:24170:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788869850.961347:0:24175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702a61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22689:x1875765325211904:12345-0@lo:5:osp-pre-0-0.0 Request processed in 15041us (15950us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788869850.961360:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788869850.961653:0:22689:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1788869850.961665:0:22689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702a63b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22689:1875765325211904:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788869850.961686:0:22689:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:3.0:1788869851.078367:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869851.981120:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788869851.981144:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325212032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869851.981215:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869851.981693:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325212032 00000100:00100000:0.0:1788869851.981703:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325212032 00000100:00100000:0.0:1788869851.981758:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869851.981769:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325212032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869851.981795:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788869851.981849:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325212032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869851.981858:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869851.981935:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325212032:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788869852.102865:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869852.999648:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869852.999676:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2827a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325212288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869852.999702:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325212160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869853.000663:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869853.000739:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325212288 00000100:00100000:1.0:1788869853.000747:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325212288 00000100:00100000:1.0:1788869853.000796:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788869853.000805:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702a61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325212288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869853.000862:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788869853.000913:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702a61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325212288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869853.000921:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788869853.001500:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869853.001560:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325212160 00000100:00100000:2.0:1788869853.001566:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325212160 00000100:00100000:2.0:1788869853.001612:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788869853.001620:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325212160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869853.001648:0:23407:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788869853.001702:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325212160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869853.001709:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788869853.001752:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325212160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869853.002881:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2827a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325212288:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788869853.125892:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869854.150816:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869854.855497:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788869855.173777:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788869856.073709:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869856.073716:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788869856.073719:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e2829c0c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869856.073728:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 784 00000100:00080000:0.0:1788869856.073733:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788869856.073746:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e2829c0c000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869856.073769:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2841000700 x1875765325212800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788869856.073817:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869856.074304:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788869856.074307:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e27029d0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869856.074313:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 784 00000100:00080000:0.0:1788869856.074316:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788869856.074322:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e27029d0800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869856.074394:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2841001500 x1875765325213312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788869856.074444:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325212928:0@lo:400:kworker.0 00000100:00100000:0.0:1788869856.074507:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869856.074559:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325213568:0@lo:400:kworker.0 00000100:00100000:0.0:1788869856.074578:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869856.074626:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788869856.074631:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325212416:0@lo:400:kworker.0 00000100:00100000:0.0:1788869856.074656:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869856.074675:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325213056:0@lo:400:kworker.0 00000100:00100000:0.0:1788869856.074700:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869856.074717:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325213696:0@lo:400:kworker.0 00000100:00100000:0.0:1788869856.074739:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869856.074763:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325212672:0@lo:400:kworker.0 00000100:00100000:0.0:1788869856.074791:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869856.074805:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325213440:0@lo:400:kworker.0 00000100:00100000:3.0:1788869856.075214:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325212544:0@lo:400:kworker.0 00000100:00100000:3.0:1788869856.075265:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869856.075288:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325213184:0@lo:400:kworker.0 00000100:00100000:3.0:1788869856.075311:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869856.075346:0:24507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325212672 00000100:00100000:3.0:1788869856.075355:0:24507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325212672 00000100:00100000:3.0:1788869856.075410:0:24507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325213184 00000100:00100000:3.0:1788869856.075413:0:24507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325213184 00000100:00100000:3.0:1788869856.075437:0:24507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869856.075446:0:24507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325212672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869856.075499:0:24507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325212672:12345-0@lo:400:kworker.0 Request processed in 55us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869856.075507:0:24507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788869856.075523:0:24507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869856.075529:0:24507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325213184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869856.075555:0:24507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325213184:12345-0@lo:400:kworker.0 Request processed in 26us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869856.075560:0:24507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788869856.075577:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325213056 00000100:00100000:3.0:1788869856.075581:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325213056 00000100:00100000:3.0:1788869856.075628:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325212544 00000100:00100000:3.0:1788869856.075630:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325212544 00000100:00100000:3.0:1788869856.075642:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788869856.075647:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325213056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869856.075682:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325213056:12345-0@lo:400:kworker.0 Request processed in 35us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869856.075700:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788869856.075711:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788869856.075716:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325212544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869856.075740:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325212544:12345-0@lo:400:kworker.0 Request processed in 25us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869856.075745:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788869856.075758:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869856.075792:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325213056:0@lo:400:kworker.0 00000100:00100000:3.0:1788869856.075813:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325212544:0@lo:400:kworker.0 00000100:00100000:3.0:1788869856.075821:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325213184:0@lo:400:kworker.0 00000100:00100000:0.0:1788869856.078151:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869856.078287:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325212672:0@lo:400:kworker.0 00000100:00100000:0.0:1788869856.078346:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325212928 00000100:00100000:0.0:1788869856.078355:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325212928 00000100:00100000:0.0:1788869856.078405:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325213568 00000100:00100000:0.0:1788869856.078408:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325213568 00000100:00100000:0.0:1788869856.078434:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325213696 00000100:00100000:0.0:1788869856.078438:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325213696 00000100:00100000:0.0:1788869856.078450:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325213440 00000100:00100000:0.0:1788869856.078453:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325213440 00000100:00100000:0.0:1788869856.078468:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788869856.078476:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325212928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869856.078558:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325212928:12345-0@lo:400:kworker.0 Request processed in 82us (4050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869856.078565:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788869856.078582:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869856.078608:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325213568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869856.078639:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325213568:12345-0@lo:400:kworker.0 Request processed in 33us (4060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869856.078645:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788869856.078656:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788869856.078663:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325213696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869856.078691:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325213696:12345-0@lo:400:kworker.0 Request processed in 29us (3951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869856.078696:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788869856.078705:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788869856.078711:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325213440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869856.078742:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325213440:12345-0@lo:400:kworker.0 Request processed in 31us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869856.078757:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788869856.078783:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325212416 00000100:00100000:0.0:1788869856.078788:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325212416 00000100:00100000:0.0:1788869856.078817:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788869856.080925:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:3650:x1875765325212416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869856.081071:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:3650:x1875765325212416:12345-0@lo:400:kworker.0 Request processed in 102us (6352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869856.081140:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1788869856.081212:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869856.081217:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869856.081397:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325212416:0@lo:400:kworker.0 00010000:00080000:0.0:1788869856.081421:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2841002300 x1875765325213696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869856.081434:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325213696:0@lo:400:kworker.0 00010000:00080000:0.0:1788869856.081447:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2841001880 x1875765325212928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869856.081455:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325212928:0@lo:400:kworker.0 00010000:00080000:0.0:1788869856.081467:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2841003480 x1875765325213568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869856.081476:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325213568:0@lo:400:kworker.0 00000100:00100000:3.0:1788869856.083406:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325213824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869856.083495:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869856.084460:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325212800:0@lo:8:kworker.0 00000100:00100000:2.0:1788869856.084511:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869856.084550:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841001500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325213312:0@lo:8:kworker.0 00000100:00100000:2.0:1788869856.084572:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869856.084944:0:24507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325212800 00000100:00100000:2.0:1788869856.084953:0:24507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325212800 00000100:00100000:2.0:1788869856.084989:0:24507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325213312 00000100:00100000:2.0:1788869856.084992:0:24507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325213312 00000100:00100000:2.0:1788869856.085011:0:24507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788869856.085031:0:24507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875765325212800:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788869856.085054:0:24507:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788869856.087736:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325213824 00000100:00100000:0.0:1788869856.087750:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325213824 00000100:00100000:0.0:1788869856.087804:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788869856.087813:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2827a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325213824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869856.087868:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788869856.087919:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2827a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325213824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (4426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869856.087927:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788869856.087961:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788869856.087967:0:24174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875765325213312:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788869856.087986:0:24174:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788869856.088026:0:24174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875765325213312:12345-0@lo:8:kworker.0 Request processed in 44us (3439us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788869856.088032:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788869856.088452:0:24507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875765325212800:12345-0@lo:8:kworker.0 Request processed in 2523us (3043us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788869856.088460:0:24507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788869856.088519:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2829c0c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869856.088525:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788869856.088529:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325212800:0@lo:8:kworker.0 00000100:00080000:2.0:1788869856.088541:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e27029d0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869856.088545:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788869856.088547:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841001500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325213312:0@lo:8:kworker.0 00000100:00100000:0.0:1788869856.088949:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325213824:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788869856.088981:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e2841003800 x1875765325213440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869856.088992:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325213440:0@lo:400:kworker.0 00010000:00010000:3.0:1788869856.203227:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788869857.012149:0:24989:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788869857.012153:0:24989:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788869857.012155:0:24989:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788869857.012280:0:24989:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e282617b000 00000020:01000004:0.0:1788869857.012295:0:24989:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788869857.012310:0:24989:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788869857.012323:0:24989:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e2840d819c0) 00000020:00000080:0.0:1788869857.012340:0:24989:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00000100:00100000:2.0:1788869857.095762:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325213952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869857.095869:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869857.095960:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325213952 00000100:00100000:2.0:1788869857.095974:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325213952 00000100:00100000:2.0:1788869857.096035:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869857.096047:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325213952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788869857.096084:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788869857.096132:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325213952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869857.096138:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869857.096191:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325213952:0@lo:13:osp-pre-0-1.0 00100000:10000000:1.0:1788869857.115324:0:24989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788869857.119313:0:24989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788869857.119583:0:24989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788869857.120444:0:24989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788869857.120649:0:24989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788869857.121147:0:24989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788869857.121451:0:24989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1788869857.124493:0:24989:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788869857.124919:0:24989:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788869857.124938:0:24989:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788869857.124951:0:24989:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4c16c38a9b6d0672 00000020:01000004:0.0:1788869857.124959:0:24989:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788869857.124982:0:24989:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.154@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788869857.124986:0:24989:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788869857.124993:0:24989:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788869857.125027:0:24989:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788869857.125031:0:24989:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788869857.154488:0:24989:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788869857.154536:0:24989:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.154@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788869857.154541:0:24989:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788869857.154543:0:24989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788869857.154545:0:24989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869857.154547:0:24989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869857.154548:0:24989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869857.154550:0:24989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869857.154557:0:24989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869857.154559:0:24989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869857.154560:0:24989:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788869857.154564:0:24989:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788869857.154566:0:24989:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788869857.154567:0:24989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788869857.154568:0:24989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869857.154569:0:24989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869857.154570:0:24989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869857.154571:0:24989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869857.154572:0:24989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869857.154573:0:24989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869857.154574:0:24989:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788869857.154655:0:24989:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788869857.154682:0:24989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325214080:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788869857.154782:0:24989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869857.154839:0:24989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e39600 going to sleep for 11 seconds 00000100:00100000:1.0:1788869857.154955:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325214080 00000100:00100000:1.0:1788869857.154964:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325214080 00000100:00100000:1.0:1788869857.155020:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788869857.155030:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:24989:x1875765325214080:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788869857.155068:0:22658:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788869857.155072:0:22658:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788869857.155076:0:22658:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788869857.155465:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:24989:x1875765325214080:12345-0@lo:253:mount.lustre.0 Request processed in 434us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869857.155474:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788869857.155659:0:24989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325214080:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788869857.155671:0:24989:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788869857.155673:0:24989:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788869857.155675:0:24989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788869857.155676:0:24989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788869857.155677:0:24989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788869857.155679:0:24989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788869857.155680:0:24989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788869857.155681:0:24989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788869857.155682:0:24989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788869857.155683:0:24989:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788869857.155704:0:24989:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e282617b000 from lustre-OST0001 10000000:01000000:3.0:1788869857.155734:0:24989:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788869857.155737:0:24989:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788869857.155746:0:24989:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e27029cb380 local copy 00010000:00010000:3.0:1788869857.155758:0:24989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9800/0x4c16c38a9b6d02ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d02b3 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869857.155866:0:24989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325214208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869857.155907:0:24989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869857.155986:0:24989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e39840 going to sleep for 11 seconds 00000100:00100000:0.0:1788869857.156353:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325214208 00000100:00100000:0.0:1788869857.156362:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325214208 00000100:00100000:0.0:1788869857.156547:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788869857.156558:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:24989:x1875765325214208:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869857.156726:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:24989:x1875765325214208:12345-0@lo:501:mount.lustre.0 Request processed in 170us (818us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788869857.156734:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788869857.156835:0:24989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325214208:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788869857.156851:0:24989:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788869857.156878:0:24989:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788869857.156887:0:24989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9800/0x4c16c38a9b6d02ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d02b3 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869857.156897:0:24989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840ed9800/0x4c16c38a9b6d02ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d02b3 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869857.156933:0:24989:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e282617b000 10000000:01000000:3.0:1788869857.156937:0:24989:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788869857.156943:0:24989:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788869857.156945:0:24989:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788869857.156949:0:24989:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788869857.156952:0:24989:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788869857.156979:0:24989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8000/0x4c16c38a9b6d0679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869857.156986:0:24989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8000/0x4c16c38a9b6d0679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869857.156994:0:24989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8000/0x4c16c38a9b6d0679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869857.157010:0:24989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325214336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788869857.157042:0:24989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869857.157481:0:24989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e39840 going to sleep for 11 seconds 00000100:00100000:2.0:1788869857.157834:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325214336 00000100:00100000:2.0:1788869857.157841:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325214336 00000100:00100000:2.0:1788869857.157873:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788869857.157883:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:24989:x1875765325214336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869857.157895:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869857.157910:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28029d7200/0x4c16c38a9b6d0680 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d0679 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.157933:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28029d7200/0x4c16c38a9b6d0680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d0679 expref: 22 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.157944:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28029d7200/0x4c16c38a9b6d0680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d0679 expref: 22 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.157952:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d7200, rc 0) 00000100:00100000:2.0:1788869857.158013:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:24989:x1875765325214336:12345-0@lo:101:mount.lustre.0 Request processed in 132us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869857.158029:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788869857.158294:0:24989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325214336:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869857.158310:0:24989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8000/0x4c16c38a9b6d0679 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0680 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869857.158318:0:24989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8000/0x4c16c38a9b6d0679 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d0680 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788869857.159736:0:24989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1788869857.160436:0:24989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869857.163101:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788869857.163168:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788869857.163186:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788869857.163200:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788869857.163213:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788869857.163242:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788869857.163256:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788869857.163273:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788869857.163289:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1788869857.163313:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1788869857.163319:0:24989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1788869857.163521:0:24989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325214464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869857.167115:0:24989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869857.167208:0:24989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869857.167407:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325214464 00000100:00100000:0.0:1788869857.167418:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325214464 00000100:00100000:0.0:1788869857.167487:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788869857.167498:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:24989:x1875765325214464:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788869857.167753:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:24989:x1875765325214464:12345-0@lo:501:mount.lustre.0 Request processed in 257us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869857.167761:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788869857.168112:0:24989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325214464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869857.168168:0:24989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325214592:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869857.168243:0:24989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869857.168281:0:24989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869857.168340:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325214592 00000100:00100000:0.0:1788869857.168345:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325214592 00000100:00100000:0.0:1788869857.168436:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788869857.168445:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:24989:x1875765325214592:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788869857.169412:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:24989:x1875765325214592:12345-0@lo:503:mount.lustre.0 Request processed in 964us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869857.169424:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788869857.171147:0:24989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325214592:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788869857.172093:0:24989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788869857.172184:0:24989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325214720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869857.172276:0:24989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869857.172340:0:24989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869857.173863:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325214720 00000100:00100000:0.0:1788869857.173877:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325214720 00000100:00100000:0.0:1788869857.173934:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788869857.173945:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:24989:x1875765325214720:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788869857.174513:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:24989:x1875765325214720:12345-0@lo:502:mount.lustre.0 Request processed in 567us (2234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869857.174521:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788869857.174677:0:24989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325214720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869857.175100:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788869857.175140:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788869857.175155:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788869857.175168:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788869857.175181:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788869857.175194:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788869857.175207:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788869857.175233:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788869857.175249:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1788869857.175285:0:24989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325214848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869857.175336:0:24989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869857.175518:0:24989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540900 going to sleep for 11 seconds 00000100:00100000:1.0:1788869857.175563:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325214848 00000100:00100000:1.0:1788869857.175571:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325214848 00000100:00100000:1.0:1788869857.175714:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788869857.175723:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:24989:x1875765325214848:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869857.175973:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:24989:x1875765325214848:12345-0@lo:502:mount.lustre.0 Request processed in 251us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869857.175981:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788869857.176077:0:24989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325214848:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788869857.176131:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1788869857.176140:0:24989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788869857.177256:0:24993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788869857.177267:0:24993:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788869857.177273:0:24993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869857.177276:0:24993:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788869857.177282:0:24993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788869857.177303:0:24993:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e27025ecd40) 00000020:00000080:3.0:1788869857.177327:0:24993:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788869857.177334:0:24993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788869857.177426:0:24993:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e282617b000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788869857.177440:0:24993:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788869857.177447:0:24993:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4c16c38a9b6d068e 00010000:00010000:3.0:1788869857.182278:0:24993:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788869857.183163:0:24993:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1788869857.185071:0:24993:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788869857.188116:0:24993:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788869857.188145:0:24993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869857.188152:0:24993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869857.188161:0:24993:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788869857.188165:0:24993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869857.188170:0:24993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869857.188171:0:24993:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788869857.188174:0:24993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788869857.188176:0:24993:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788869857.188178:0:24993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869857.188180:0:24993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869857.188182:0:24993:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788869857.188184:0:24993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869857.188186:0:24993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869857.188187:0:24993:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788869857.188191:0:24993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788869857.188235:0:24993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869857.188239:0:24993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869857.188240:0:24993:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788869857.188244:0:24993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1788869857.188473:0:24989:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788869857.188507:0:24989:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788869857.188530:0:24989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8000/0x4c16c38a9b6d0679 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0680 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869857.188543:0:24989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8000/0x4c16c38a9b6d0679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0680 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869857.188552:0:24989:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e282617b000 from 1 10000000:01000000:1.0:1788869857.188555:0:24989:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869857.188621:0:24989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edbc00/0x4c16c38a9b6d0695 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869857.188637:0:24989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840edbc00/0x4c16c38a9b6d0695 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869857.188650:0:24989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840edbc00/0x4c16c38a9b6d0695 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869857.188680:0:24989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702a60000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325214976:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788869857.188753:0:24989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869857.188788:0:24989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0c60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788869857.191064:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325214976 00000100:00100000:1.0:1788869857.191079:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325214976 00000100:00100000:1.0:1788869857.191142:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788869857.191153:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:24989:x1875765325214976:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788869857.191169:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869857.191188:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840eda200/0x4c16c38a9b6d069c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d0695 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869857.191215:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840eda200/0x4c16c38a9b6d069c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d0695 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869857.191236:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840eda200/0x4c16c38a9b6d069c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d0695 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869857.191245:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda200, rc 0) 00000100:00100000:1.0:1788869857.191330:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:24989:x1875765325214976:12345-0@lo:101:mount.lustre.0 Request processed in 179us (2577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869857.191336:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788869857.191501:0:24989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702a60000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325214976:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869857.191521:0:24989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840edbc00/0x4c16c38a9b6d0695 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d069c expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869857.191531:0:24989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840edbc00/0x4c16c38a9b6d0695 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d069c expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788869857.192959:0:24989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1788869857.193268:0:24989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788869857.193674:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788869857.193701:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788869857.193717:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788869857.193730:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788869857.193743:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788869857.193756:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788869857.193769:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788869857.193795:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788869857.193931:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788869857.193945:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1788869857.193959:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1788869857.193979:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1788869857.193986:0:24989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1788869857.194085:0:24989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325215104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869857.194168:0:24989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869857.194206:0:24989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28098a1180 going to sleep for 11 seconds 00000100:00100000:1.0:1788869857.194298:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325215104 00000100:00100000:1.0:1788869857.194307:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325215104 00000100:00100000:1.0:1788869857.194377:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788869857.194387:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:24989:x1875765325215104:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869857.194506:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:24989:x1875765325215104:12345-0@lo:501:mount.lustre.0 Request processed in 120us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869857.194514:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788869857.194807:0:24989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325215104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788869857.194838:0:24989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325215232:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788869857.194881:0:24989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869857.194911:0:24989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28098a1180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869857.195008:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325215232 00000100:00100000:2.0:1788869857.195014:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325215232 00000100:00100000:2.0:1788869857.195053:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788869857.195061:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:24989:x1875765325215232:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869857.195160:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:24989:x1875765325215232:12345-0@lo:503:mount.lustre.0 Request processed in 99us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869857.195167:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788869857.195209:0:24989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325215232:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788869857.195647:0:24989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788869857.195711:0:24989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325215360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869857.195749:0:24989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869857.195778:0:24989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869857.195795:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325215360 00000100:00100000:2.0:1788869857.195981:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325215360 00000100:00100000:2.0:1788869857.196015:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788869857.196023:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:24989:x1875765325215360:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869857.196124:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:24989:x1875765325215360:12345-0@lo:502:mount.lustre.0 Request processed in 102us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869857.196138:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788869857.196184:0:24989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325215360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869857.196470:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788869857.196498:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788869857.196512:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788869857.196526:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788869857.196541:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788869857.196553:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788869857.196566:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788869857.196580:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788869857.196627:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788869857.196640:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788869857.196652:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788869857.196675:0:24989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325215488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869857.196715:0:24989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869857.196743:0:24989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2817540f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869857.196759:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325215488 00000100:00100000:2.0:1788869857.196763:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325215488 00000100:00100000:2.0:1788869857.196785:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788869857.196792:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:24989:x1875765325215488:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869857.197104:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:24989:x1875765325215488:12345-0@lo:502:mount.lustre.0 Request processed in 311us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869857.197111:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788869857.197188:0:24989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325215488:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788869857.197251:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788869857.197261:0:24989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788869857.204321:0:24996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869857.204336:0:24996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869857.204338:0:24996:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788869857.204354:0:24996:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e282617b000 00000020:00000080:3.0:1788869857.204357:0:24996:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788869857.204371:0:24996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869857.204373:0:24996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869857.204375:0:24996:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788869857.204377:0:24996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869857.204379:0:24996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869857.204380:0:24996:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788869857.204383:0:24996:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e282617b000 00000020:00000080:3.0:1788869857.204384:0:24996:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788869857.205045:0:24996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869857.205054:0:24996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869857.205055:0:24996:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788869857.205058:0:24996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869857.205061:0:24996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869857.205062:0:24996:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788869857.205066:0:24996:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e282617b000 00000020:00000080:3.0:1788869857.205068:0:24996:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788869857.205095:0:24996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869857.205098:0:24996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869857.205099:0:24996:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788869857.205102:0:24996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788869857.205105:0:24996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869857.205106:0:24996:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788869857.205109:0:24996:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e282617b000 00000020:00000080:3.0:1788869857.205111:0:24996:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788869857.205140:0:24996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788869857.205143:0:24996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788869857.205145:0:24996:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788869857.205149:0:24996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788869857.207539:0:24989:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788869857.207597:0:24989:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788869857.207618:0:24989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edbc00/0x4c16c38a9b6d0695 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d069c expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.207642:0:24989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840edbc00/0x4c16c38a9b6d0695 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d069c expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869857.207702:0:24989:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788869857.207705:0:24989:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e282617b000 10000000:01000000:2.0:1788869857.207708:0:24989:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e282617b000 10000000:01000000:2.0:1788869857.207712:0:24989:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788869857.207719:0:24989:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e282617b000 from 1 10000000:01000000:2.0:1788869857.207722:0:24989:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788869857.207764:0:24989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6d06a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.207773:0:24989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6d06a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.207784:0:24989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6d06a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869857.207819:0:24989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325215616:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788869857.207880:0:24989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869857.207923:0:24989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802fa93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869857.208060:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325215616 00000100:00100000:3.0:1788869857.208068:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325215616 00000100:00100000:3.0:1788869857.208115:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788869857.208125:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:24989:x1875765325215616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788869857.208139:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869857.208151:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6d06aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d06a3 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869857.208174:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6d06aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d06a3 expref: 24 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869857.208184:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840ed9400/0x4c16c38a9b6d06aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d06a3 expref: 24 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869857.208199:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9400, rc 0) 00000100:00100000:3.0:1788869857.208245:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:24989:x1875765325215616:12345-0@lo:101:mount.lustre.0 Request processed in 121us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869857.208252:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788869857.208754:0:24989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325215616:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788869857.208770:0:24989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6d06a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d06aa expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.208780:0:24989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6d06a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d06aa expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869857.213938:0:24989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788869857.214308:0:24989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869857.214522:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788869857.214551:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788869857.214564:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788869857.214575:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788869857.214630:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788869857.214647:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788869857.214660:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788869857.214673:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788869857.214686:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788869857.214699:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788869857.214713:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788869857.214726:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788869857.214740:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788869857.214753:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788869857.214789:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788869857.214881:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788869857.214900:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788869857.214915:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788869857.214929:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788869857.214942:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788869857.214954:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788869857.214967:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788869857.214980:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788869857.214994:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788869857.215007:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788869857.215021:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788869857.215035:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788869857.215050:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788869857.215063:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788869857.215089:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788869857.215120:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788869857.215137:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788869857.215150:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788869857.215164:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788869857.215178:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788869857.215191:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788869857.215204:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788869857.215227:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788869857.215244:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788869857.215258:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788869857.215272:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788869857.215285:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788869857.215299:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788869857.215313:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788869857.215328:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788869857.215342:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788869857.215371:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788869857.215390:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788869857.215527:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788869857.215548:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788869857.215566:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788869857.215572:0:24989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788869857.215739:0:24989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325215744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788869857.215859:0:24989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869857.215943:0:24989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802fa9840 going to sleep for 11 seconds 00000100:00100000:1.0:1788869857.219412:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325215744 00000100:00100000:1.0:1788869857.219427:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325215744 00000100:00100000:1.0:1788869857.219500:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788869857.219511:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:24989:x1875765325215744:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869857.219764:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:24989:x1875765325215744:12345-0@lo:501:mount.lustre.0 Request processed in 253us (3903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869857.219773:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788869857.221459:0:24989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325215744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788869857.221526:0:24989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702a60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325215872:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788869857.221618:0:24989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869857.221660:0:24989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1900 going to sleep for 11 seconds 00000100:00100000:2.0:1788869857.221920:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325215872 00000100:00100000:2.0:1788869857.221928:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325215872 00000100:00100000:2.0:1788869857.221988:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788869857.221997:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:24989:x1875765325215872:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788869857.222139:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:24989:x1875765325215872:12345-0@lo:503:mount.lustre.0 Request processed in 143us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869857.222154:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788869857.222209:0:24989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702a60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325215872:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788869857.223043:0:24989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788869857.223128:0:24989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325216000:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869857.223190:0:24989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869857.226496:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325216000 00000100:00100000:1.0:1788869857.226517:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325216000 00000100:00100000:1.0:1788869857.226615:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788869857.226626:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:24989:x1875765325216000:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869857.226835:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:24989:x1875765325216000:12345-0@lo:502:mount.lustre.0 Request processed in 211us (3645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869857.226843:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788869857.227000:0:24989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802fa93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869857.227026:0:24989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325216000:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788869857.227281:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788869857.227316:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788869857.227331:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788869857.228560:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788869857.228616:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788869857.228634:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788869857.228648:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788869857.228660:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788869857.228706:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788869857.228723:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788869857.228735:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788869857.228747:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788869857.228759:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788869857.228770:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788869857.228783:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00010000:00010000:3.0:1788869857.229949:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869857.230930:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788869857.230979:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788869857.230993:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788869857.231004:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788869857.231015:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788869857.231026:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788869857.231050:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788869857.231062:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788869857.231074:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788869857.231102:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788869857.231114:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788869857.231125:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788869857.231135:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788869857.231145:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788869857.231155:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788869857.231165:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788869857.231175:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788869857.231185:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788869857.231196:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1788869857.231208:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1788869857.231234:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1788869857.231250:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1788869857.231262:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1788869857.231273:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1788869857.231285:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1788869857.231311:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1788869857.231328:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1788869857.232447:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788869857.232503:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1788869857.232520:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1788869857.232534:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1788869857.232549:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1788869857.232565:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1788869857.232644:0:24989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325216128:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869857.232738:0:24989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869857.233515:0:24989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2807986e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788869857.238091:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325216128 00000100:00100000:3.0:1788869857.238112:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325216128 00000100:00100000:3.0:1788869857.238190:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788869857.238201:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:24989:x1875765325216128:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788869857.239017:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:24989:x1875765325216128:12345-0@lo:502:mount.lustre.0 Request processed in 814us (6277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869857.239027:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788869857.239549:0:24989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325216128:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788869857.240721:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1788869857.240756:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1788869857.241429:0:24989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702a63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325216256:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788869857.241518:0:24989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869857.241573:0:24989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788869857.241964:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325216256 00000100:00100000:2.0:1788869857.241973:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325216256 00000100:00100000:2.0:1788869857.242033:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788869857.242041:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:24989:x1875765325216256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788869857.242193:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:24989:x1875765325216256:12345-0@lo:502:mount.lustre.0 Request processed in 152us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869857.242201:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788869857.242524:0:24989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702a63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325216256:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788869857.242645:0:24989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788869857.242659:0:24989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788869857.245579:0:25002:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788869857.246937:0:25002:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e2840d84d40) 00000020:00000080:0.0:1788869857.246973:0:25002:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788869857.247103:0:25002:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e282617b000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788869857.247108:0:25002:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e282617b000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788869857.247112:0:25002:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e282617b000 3 00010000:00080000:0.0:1788869857.247148:0:25002:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e270265e800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1788869857.255830:0:25002:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788869857.256073:0:25002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788869857.256147:0:25002:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788869857.262672:0:25002:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4c16c38a9b6d06b8 00000100:00080000:1.0:1788869857.262693:0:25002:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788869857.262710:0:25002:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e270265e800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869857.263872:0:25002:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2702a63480 x1875765325216384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788869857.263902:0:25002:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788869857.263955:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869857.263959:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788869857.263962:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e2829c0c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869857.263966:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 789 00000100:00080000:1.0:1788869857.263970:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788869857.263976:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e2829c0c000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869857.263987:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2702a63b80 x1875765325216768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788869857.264014:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788869857.264017:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788869857.264018:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e27029d0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788869857.264027:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 789 00000100:00080000:1.0:1788869857.264029:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788869857.264033:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e27029d0800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869857.264055:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e270340df80 x1875765325217152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788869857.264099:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702a60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325216512:0@lo:400:kworker.0 00000100:00100000:1.0:1788869857.264162:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869857.264192:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270340ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325217280:0@lo:400:kworker.0 00000100:00100000:1.0:1788869857.264211:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869857.264249:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788869857.264255:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702a60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325216640:0@lo:400:kworker.0 00000100:00100000:1.0:1788869857.264275:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869857.264296:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270340ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325217408:0@lo:400:kworker.0 00000100:00100000:1.0:1788869857.264312:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869857.264338:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325216896:0@lo:400:kworker.0 00000100:00100000:1.0:1788869857.264355:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869857.264368:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270340e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325217536:0@lo:400:kworker.0 00000100:00100000:1.0:1788869857.264383:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869857.264395:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869857.264399:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702a62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325217024:0@lo:400:kworker.0 00000100:00100000:1.0:1788869857.264414:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869857.264437:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325216512 00000100:00100000:1.0:1788869857.264444:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325216512 00000100:00100000:1.0:1788869857.264478:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325217024 00000100:00100000:1.0:1788869857.264480:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325217024 00000100:00100000:1.0:1788869857.264493:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788869857.264507:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270340ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325216512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869857.264554:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270340ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325216512:12345-0@lo:400:kworker.0 Request processed in 48us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869857.264561:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788869857.264576:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788869857.264581:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270340d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325217024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869857.264628:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270340d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325217024:12345-0@lo:400:kworker.0 Request processed in 47us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869857.264633:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788869857.264648:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325217280 00000100:00100000:1.0:1788869857.264651:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325217280 00000100:00100000:1.0:1788869857.264671:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325217408 00000100:00100000:1.0:1788869857.264673:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325217408 00000100:00100000:1.0:1788869857.264681:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325216896 00000100:00100000:1.0:1788869857.264683:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325216896 00000100:00100000:1.0:1788869857.264691:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325217536 00000100:00100000:1.0:1788869857.264693:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325217536 00000100:00100000:1.0:1788869857.264703:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788869857.264708:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270340c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325217280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869857.264732:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270340c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325217280:12345-0@lo:400:kworker.0 Request processed in 24us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869857.264737:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788869857.264745:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788869857.264750:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270340c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325217408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869857.264767:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270340c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325217408:12345-0@lo:400:kworker.0 Request processed in 17us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869857.264771:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788869857.264790:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788869857.264796:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270340d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325216896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869857.264823:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270340d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325216896:12345-0@lo:400:kworker.0 Request processed in 27us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869857.264828:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788869857.264838:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788869857.264843:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270340fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325217536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869857.264866:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270340fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875765325217536:12345-0@lo:400:kworker.0 Request processed in 23us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869857.264871:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788869857.264918:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e270340ed80 x1875765325217408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869857.264930:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270340ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325217408:0@lo:400:kworker.0 00000100:00100000:1.0:1788869857.264940:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702a60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325216512:0@lo:400:kworker.0 00010000:00080000:1.0:1788869857.264949:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e270340ce00 x1875765325217280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869857.264956:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270340ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325217280:0@lo:400:kworker.0 00000100:00100000:1.0:1788869857.264985:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702a62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325217024:0@lo:400:kworker.0 00010000:00080000:1.0:1788869857.264995:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2702a62a00 x1875765325216896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869857.265001:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325216896:0@lo:400:kworker.0 00010000:00080000:1.0:1788869857.265009:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e270340e300 x1875765325217536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869857.265027:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270340e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875765325217536:0@lo:400:kworker.0 00000100:00100000:0.0:1788869857.265277:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325216640 00000100:00100000:0.0:1788869857.265282:0:24174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325216640 00000100:00100000:0.0:1788869857.265322:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788869857.265329:0:24174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270340d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325216640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869857.265371:0:24174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270340d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325216640:12345-0@lo:400:kworker.0 Request processed in 44us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869857.265378:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788869857.265808:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702a63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765325216384:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788869857.265856:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869857.265909:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702a63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325216768:0@lo:8:kworker.0 00000100:00100000:2.0:1788869857.265934:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869857.265953:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270340df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325217152:0@lo:8:kworker.0 00000100:00100000:2.0:1788869857.265973:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869857.266007:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325216768 00000100:00100000:2.0:1788869857.266012:0:24176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325216768 00000100:00100000:2.0:1788869857.266031:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325217152 00000100:00100000:2.0:1788869857.266034:0:24176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325217152 00000100:00100000:2.0:1788869857.266045:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788869857.266049:0:24176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875765325216768:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788869857.266108:0:24176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875765325216768:12345-0@lo:8:kworker.0 Request processed in 57us (174us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788869857.266114:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788869857.266126:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788869857.266130:0:24176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875765325217152:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788869857.266155:0:24176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875765325217152:12345-0@lo:8:kworker.0 Request processed in 24us (181us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788869857.266160:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788869857.266188:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788869857.266194:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2829c0c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869857.266205:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788869857.266208:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702a63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325216768:0@lo:8:kworker.0 00000100:00100000:2.0:1788869857.266229:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788869857.266233:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e27029d0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788869857.266236:0:3647:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788869857.266238:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270340df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325217152:0@lo:8:kworker.0 00000100:00100000:0.0:1788869857.267793:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325216384 00000100:00100000:0.0:1788869857.268015:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325216384 00000100:00100000:0.0:1788869857.268061:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788869857.268068:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875765325216384:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788869857.268095:0:22664:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 791 last 0 00000020:00000080:0.0:1788869857.268135:0:22664:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4c16c38a9b6d06bf 00000004:00100000:0.0:1788869857.268155:0:22664:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788869857.268196:0:22664:0:(import.c:65:import_set_state_nolock()) ffff8e2702659000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869857.268318:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875765325216384:12345-0@lo:38:llog_process_th.0 Request processed in 248us (2460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869857.268325:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788869857.269136:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2702a63480 x1875765325216384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869857.269151:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788869857.269160:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788869857.269168:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788869857.269174:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788869857.269177:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e270265e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788869857.269183:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702a63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875765325216384:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788869857.269538:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702a60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325216640:0@lo:400:kworker.0 00000020:01000004:1.0:1788869857.274532:0:25002:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788869857.274552:0:25002:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8e28411e3380) 00000020:00000080:1.0:1788869857.274578:0:25002:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788869857.274739:0:25002:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e282617b000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788869857.274744:0:25002:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e282617b000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788869857.274747:0:25002:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e282617b000 3 00010000:00080000:1.0:1788869857.274781:0:25002:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e2704042800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.154@tcp at head 00010000:00010000:1.0:1788869857.282711:0:25002:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788869857.284244:0:25002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788869857.284298:0:25002:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788869857.284313:0:25002:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x4c16c38a9b6d06cd 00000100:00080000:1.0:1788869857.284326:0:25002:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788869857.284338:0:25002:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8e2704042800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:1.0:1788869857.285504:0:25002:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e270340e300 x1875765325217664/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788869857.285543:0:25002:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788869857.286482:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270340e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765325217664:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788869857.286576:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869857.286676:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325217664 00000100:00100000:3.0:1788869857.286685:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325217664 00000100:00100000:3.0:1788869857.286721:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788869857.286729:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875765325217664:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788869857.286758:0:23784:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 791 last 0 00000020:00000080:3.0:1788869857.287422:0:23784:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x4c16c38a9b6d06d4 00000004:00100000:3.0:1788869857.287443:0:23784:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788869857.287490:0:23784:0:(import.c:65:import_set_state_nolock()) ffff8e2841fec000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869857.287605:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875765325217664:12345-0@lo:38:llog_process_th.0 Request processed in 854us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869857.287613:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788869857.287688:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e270340e300 x1875765325217664/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788869867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869857.287700:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788869857.287710:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788869857.287718:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788869857.287724:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788869857.287726:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2704042800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788869857.287732:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270340e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875765325217664:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788869857.288020:0:25002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1788869857.288088:0:24989:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788869857.288118:0:24989:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788869857.288134:0:24989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6d06a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d06aa expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869857.288146:0:24989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e28029d6200/0x4c16c38a9b6d06a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d06aa expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788869857.288205:0:24989:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788869857.288207:0:24989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788869857.288208:0:24989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869857.288210:0:24989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869857.288211:0:24989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869857.288213:0:24989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869857.288214:0:24989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869857.288230:0:24989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869857.288231:0:24989:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788869857.288235:0:24989:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788869857.288237:0:24989:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788869857.288239:0:24989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788869857.288240:0:24989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869857.288241:0:24989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869857.288242:0:24989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869857.288243:0:24989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869857.288244:0:24989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869857.288245:0:24989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869857.288246:0:24989:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788869857.288265:0:24989:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788869857.288280:0:24989:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270340ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325217792:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788869857.288335:0:24989:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869857.289782:0:24989:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840da1900 going to sleep for 11 seconds 00000100:00100000:3.0:1788869857.290533:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325217792 00000100:00100000:3.0:1788869857.290544:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325217792 00000100:00100000:3.0:1788869857.290622:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788869857.290634:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:24989:x1875765325217792:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788869857.290665:0:22658:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788869857.290680:0:22658:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788869857.304527:0:22658:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788869857.304550:0:22658:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788869857.306835:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:24989:x1875765325217792:12345-0@lo:253:mount.lustre.0 Request processed in 16196us (18492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869857.306850:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788869857.306985:0:24989:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270340ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c082ff99-6a3f-4428-a6f2-973bbd93c10a:24989:1875765325217792:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788869857.307001:0:24989:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788869857.307005:0:24989:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788869857.307007:0:24989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788869857.307008:0:24989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788869857.307009:0:24989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788869857.307011:0:24989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788869857.307012:0:24989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788869857.307013:0:24989:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788869857.307015:0:24989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788869857.307016:0:24989:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788869857.307029:0:24989:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788869857.307654:0:22680:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788869857.307661:0:22680:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788869857.307684:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e28029d6400/0x4c16c38a9b6d06db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.307701:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d056f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d0568 expref: 23 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.307709:0:22680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e282dbb4800/0x4c16c38a9b6d057d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d0576 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.307716:0:22680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e28029d6400/0x4c16c38a9b6d06db lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.307768:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e282dbb4800/0x4c16c38a9b6d057d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6d0576 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.307785:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e282dbb4800/0x4c16c38a9b6d057d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6d0576 expref: 23 pid: 22659 timeout: 891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869857.307801:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875765325217920:0@lo:104: 00000100:00100000:2.0:1788869857.307860:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788869857.307923:0:22680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d056f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6d0568 expref: 23 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.307931:0:22680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d056f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6d0568 expref: 23 pid: 22658 timeout: 891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869857.307939:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a33480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875765325218048:0@lo:104: 00000100:00100000:2.0:1788869857.307961:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869857.307980:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282dbb7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869857.307998:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325217920 00000100:00100000:2.0:1788869857.308006:0:22647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325217920 00000100:00100000:2.0:1788869857.308039:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325218048 00000100:00100000:2.0:1788869857.308042:0:22647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325218048 00000100:00100000:2.0:1788869857.308055:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869857.308063:0:22647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+4:22680:x1875765325217920:12345-0@lo:104: 00010000:00010000:2.0:1788869857.308076:0:22647:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6d0576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d057d expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.308120:0:22647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788869857.308125:0:22647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+4:22680:x1875765325217920:12345-0@lo:104: Request processed in 64us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869857.308138:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869857.308151:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869857.308156:0:22647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+3:22680:x1875765325218048:12345-0@lo:104: 00010000:00010000:2.0:1788869857.308163:0:22647:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d0568 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d056f expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.308193:0:22647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788869857.308197:0:22647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+3:22680:x1875765325218048:12345-0@lo:104: Request processed in 42us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869857.308202:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869857.308238:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875765325217920:0@lo:104: 00000100:00100000:2.0:1788869857.308244:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a33480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22680:1875765325218048:0@lo:104: 00010000:00010000:2.0:1788869857.308261:0:22680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e28029d6400/0x4c16c38a9b6d06db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.308277:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869857.308284:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6d0576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d057d expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.308291:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edba00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869857.308295:0:22653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6d0576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6d057d expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.308303:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6d0576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6d057d expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869857.308310:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6d0576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6d057d expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869857.308322:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869857.308359:0:22653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6d0576 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d057d expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.308920:0:22653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869857.308943:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6d0576 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d057d expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.308951:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840edba00/0x4c16c38a9b6d0576 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d057d expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.308965:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869857.308968:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d0568 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d056f expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.308974:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5c00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869857.308978:0:22653:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d0568 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6d056f expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.308986:0:22653:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d0568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6d056f expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869857.308993:0:22653:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d0568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6d056f expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869857.308999:0:22653:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788869857.309016:0:22653:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d0568 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d056f expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.309021:0:22653:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869857.309044:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d0568 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d056f expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.309051:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e282dbb5c00/0x4c16c38a9b6d0568 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d056f expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.309064:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869857.309066:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869857.309067:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869857.309076:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869857.309097:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3649:1875765325218176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869857.309141:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869857.309177:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325218304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869857.309195:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869857.309234:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325218176 00000100:00100000:2.0:1788869857.309239:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325218176 00010000:00010000:2.0:1788869857.309258:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e282dbb4800/0x4c16c38a9b6d057d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d0576 expref: 24 pid: 22659 timeout: 891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869857.309277:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325218304 00000100:00100000:2.0:1788869857.309280:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325218304 00010000:00010000:2.0:1788869857.309288:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d056f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d0568 expref: 25 pid: 22658 timeout: 891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869857.309298:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869857.309303:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+25:3649:x1875765325218176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869857.309313:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869857.309318:0:22651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e282dbb4800/0x4c16c38a9b6d057d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d0576 expref: 25 pid: 22659 timeout: 891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.309349:0:22651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e282dbb4800/0x4c16c38a9b6d057d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6d0576 expref: 25 pid: 22659 timeout: 891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.310624:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e282dbb4800/0x4c16c38a9b6d057d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6d0576 expref: 25 pid: 22659 timeout: 891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.310644:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869857.310722:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:3649:x1875765325218176:12345-0@lo:103:ldlm_bl.0 Request processed in 1417us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869857.310731:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869857.310756:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869857.310764:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:3650:x1875765325218304:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788869857.310919:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3649:1875765325218176:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869857.311163:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869857.311171:0:22651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d056f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d0568 expref: 23 pid: 22658 timeout: 891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.311183:0:22651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d056f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6d0568 expref: 23 pid: 22658 timeout: 891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.311199:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840eda600/0x4c16c38a9b6d056f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6d0568 expref: 23 pid: 22658 timeout: 891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.311210:0:22651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e28029d6400/0x4c16c38a9b6d06db lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.311230:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28029d6400/0x4c16c38a9b6d06db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788869857.311245:0:22651:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010361026s 00010000:00010000:2.0:1788869857.311258:0:22651:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e28029d6400/0x4c16c38a9b6d06db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.311266:0:22651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e28029d6400/0x4c16c38a9b6d06db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.311273:0:22651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e28029d6400/0x4c16c38a9b6d06db lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.311280:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e28029d6400/0x4c16c38a9b6d06db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.311286:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869857.311290:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e28029d6400/0x4c16c38a9b6d06db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.311298:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e28029d6400/0x4c16c38a9b6d06db lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1788869857.312558:0:24989:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788869857.317460:0:24989:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788869857.317474:0:24989:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788869857.317526:0:24989:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788869857.317614:0:24989:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788869857.317636:0:24989:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788869857.317657:0:24989:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788869857.318613:0:24989:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788869857.318859:0:24989:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788869857.322029:0:22680:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e28029d6400/0x4c16c38a9b6d06db lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869857.322049:0:22680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e28029d6400/0x4c16c38a9b6d06db lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.327477:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e28029d6400/0x4c16c38a9b6d06db lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.327499:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28029d6400/0x4c16c38a9b6d06db lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869857.327527:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869857.327651:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:3650:x1875765325218304:12345-0@lo:103:ldlm_bl.0 Request processed in 16884us (18450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869857.327662:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869857.327738:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325218304:0@lo:103:ldlm_bl.0 00000040:00080000:0.0:1788869857.805310:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788869858.118064:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869858.118090:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270340ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325218432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869858.118175:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869858.118471:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325218432 00000100:00100000:1.0:1788869858.118481:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325218432 00000100:00100000:1.0:1788869858.118549:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788869858.118561:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325218432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869858.118621:0:23407:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788869858.118678:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325218432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869858.118685:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788869858.118972:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270340ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325218560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788869858.119021:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869858.119172:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325218560 00000100:00100000:1.0:1788869858.119178:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325218560 00000100:00100000:1.0:1788869858.119227:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788869858.119234:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325218560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869858.119257:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788869858.119305:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325218560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869858.119312:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788869858.119635:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270340ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325218432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869858.120170:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270340ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325218560:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788869858.246187:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788869858.410996:0:25056:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788869858.411467:0:25056:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788869859.270180:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788869859.336630:0:22661:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788869859.336641:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e2704079800 from 14 10000000:01000000:3.0:1788869859.336646:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788869859.336711:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8a00/0x4c16c38a9b6d06e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869859.336725:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8a00/0x4c16c38a9b6d06e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869859.336757:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8a00/0x4c16c38a9b6d06e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869859.336791:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841000700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325218688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788869859.336891:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869859.336952:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0cad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788869859.337518:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325218688 00000100:00100000:2.0:1788869859.337538:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325218688 00000100:00100000:2.0:1788869859.337623:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788869859.337635:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:22661:x1875765325218688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869859.337655:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869859.337674:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28029d7000/0x4c16c38a9b6d06e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d06e2 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869859.337703:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28029d7000/0x4c16c38a9b6d06e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d06e2 expref: 23 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869859.337715:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28029d7000/0x4c16c38a9b6d06e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d06e2 expref: 23 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869859.337724:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d7000, rc 0) 00000100:00100000:2.0:1788869859.337805:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:22661:x1875765325218688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869859.337812:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788869859.338626:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841000700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325218688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869859.338648:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8a00/0x4c16c38a9b6d06e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d06e9 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869859.338661:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8a00/0x4c16c38a9b6d06e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d06e9 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869859.338743:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841000700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325218816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788869859.338808:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869859.339055:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0cad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869859.339128:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325218816 00000100:00100000:1.0:1788869859.339136:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325218816 00000100:00100000:1.0:1788869859.339196:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788869859.339207:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:22661:x1875765325218816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788869859.339226:0:22658:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788869859.339245:0:22658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788869859.339369:0:22658:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788869859.339473:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:22661:x1875765325218816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 268us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869859.339481:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788869859.340248:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841000700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325218816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788869859.340393:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788869859.340404:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8a00/0x4c16c38a9b6d06e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d06e9 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869859.340416:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8a00/0x4c16c38a9b6d06e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d06e9 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788869859.340428:0:22661:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788869859.340431:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e283b011000 from 14 10000000:01000000:3.0:1788869859.340441:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788869859.340476:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6d06f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869859.340485:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6d06f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869859.340494:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6d06f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869859.340515:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841000700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325218944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788869859.341406:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869859.341435:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0cad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788869859.341464:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325218944 00000100:00100000:3.0:1788869859.341471:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325218944 00000100:00100000:3.0:1788869859.341538:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788869859.341548:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:22661:x1875765325218944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869859.341567:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869859.341601:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840ed9a00/0x4c16c38a9b6d06f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d06f0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869859.341630:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840ed9a00/0x4c16c38a9b6d06f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d06f0 expref: 24 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869859.341642:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840ed9a00/0x4c16c38a9b6d06f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d06f0 expref: 24 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869859.341651:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed9a00, rc 0) 00000100:00100000:3.0:1788869859.341689:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:22661:x1875765325218944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869859.341708:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788869859.341765:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841000700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325218944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869859.341778:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6d06f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d06f7 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869859.341786:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6d06f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d06f7 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869859.342238:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841000700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325219072:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788869859.342410:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869859.342437:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282f0cad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788869859.342639:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325219072 00000100:00100000:1.0:1788869859.342655:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325219072 00000100:00100000:1.0:1788869859.342690:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788869859.342699:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:22661:x1875765325219072:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788869859.342719:0:22658:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788869859.342737:0:22658:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788869859.342741:0:22658:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788869859.342984:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:22661:x1875765325219072:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 286us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869859.342993:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788869859.343106:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841000700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325219072:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788869859.343188:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788869859.343199:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6d06f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d06f7 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869859.343208:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840ed8400/0x4c16c38a9b6d06f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d06f7 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869860.299477:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869861.190722:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788869861.190748:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270340dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325219200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869861.190827:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869861.190880:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325219200 00000100:00100000:1.0:1788869861.190889:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325219200 00000100:00100000:1.0:1788869861.191026:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869861.191037:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270340c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325219200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869861.191076:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788869861.192053:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270340c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325219200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869861.192067:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788869861.192103:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869861.192418:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270340dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325219200:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788869861.323955:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869862.214188:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869862.214220:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325219328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788869862.214297:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869862.214367:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325219328 00000100:00100000:2.0:1788869862.214377:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325219328 00000100:00100000:2.0:1788869862.214439:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788869862.214449:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325219328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788869862.214489:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788869862.214538:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325219328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869862.214546:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788869862.214567:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869862.214631:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325219328:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788869862.342746:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869862.734348:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3651:1875765325219456:0@lo:400:kworker.0 00000100:00100000:2.0:1788869862.734434:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788869862.737300:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869862.737307:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788869862.737311:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e2829c0c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869862.737331:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e2829c0c000 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869862.737360:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e2703a30380 x1875765325219840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788869862.737700:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325219840:0@lo:8:kworker.0 00000100:00100000:3.0:1788869862.737779:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869862.738012:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325219840 00000100:00100000:2.0:1788869862.738021:0:24176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325219840 00000100:00100000:2.0:1788869862.738061:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869862.738068:0:24176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841003480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875765325219840:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788869862.738205:0:24176:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 796 last 0 00000020:00000080:2.0:1788869862.738237:0:24176:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4c16c38a9b6d06fe 00002000:00100000:2.0:1788869862.738251:0:24176:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e270351f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788869862.738256:0:24176:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788869862.738259:0:24176:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788869862.738477:0:24176:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788869862.738509:0:24176:0:(import.c:65:import_set_state_nolock()) ffff8e2703518000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869862.738605:0:24176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841003480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875765325219840:12345-0@lo:8:kworker.0 Request processed in 518us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869862.738613:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788869862.738660:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325219456 00000100:00100000:2.0:1788869862.738666:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325219456 00000100:00100000:2.0:1788869862.738698:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788869862.738705:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:3651:x1875765325219456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869862.738749:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:3651:x1875765325219456:12345-0@lo:400:kworker.0 Request processed in 45us (4316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869862.738756:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:2.0:1788869862.738807:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a30380 x1875765325219840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788869862.738823:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788869862.738831:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788869862.738836:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788869862.738839:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e2829c0c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788869862.738853:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788869862.738859:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875765325219840:0@lo:8:kworker.0 00000004:00080000:2.0:1788869862.738990:0:22691:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1788869862.739010:0:22691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22691:1875765325220224:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788869862.739038:0:22691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869862.739061:0:22691:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28279d7180 going to sleep for 11 seconds 00000004:00080000:2.0:1788869862.739077:0:22690:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788869862.740288:0:22690:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 796653699186ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788869862.740300:0:22690:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788869862.740339:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325220224 00000100:00100000:2.0:1788869862.740348:0:24174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325220224 00000100:00100000:2.0:1788869862.740400:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788869862.740409:0:24174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22691:x1875765325220224:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1788869862.740806:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869862.743035:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788869862.743042:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788869862.743045:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e27029d0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788869862.743061:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8e27029d0800 using connection 192.168.204.154@tcp/0@lo 00000100:00100000:0.0:1788869862.743098:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e282f045f80 x1875765325220480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788869862.743348:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325219968:0@lo:400:kworker.0 00000100:00100000:0.0:1788869862.743418:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869862.743457:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325220736:0@lo:400:kworker.0 00000100:00100000:0.0:1788869862.743479:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869862.743506:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788869862.743513:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325220096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869862.743605:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869862.743625:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325220864:0@lo:400:kworker.0 00000100:00100000:0.0:1788869862.743648:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869862.743679:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325219584:0@lo:400:kworker.0 00000100:00100000:0.0:1788869862.743719:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869862.743737:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325220352:0@lo:400:kworker.0 00000100:00100000:0.0:1788869862.743757:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869862.743772:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325220992:0@lo:400:kworker.0 00000100:00100000:0.0:1788869862.743793:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869862.743819:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788869862.743826:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325219712:0@lo:400:kworker.0 00000100:00100000:0.0:1788869862.743848:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869862.744099:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3651:1875765325219456:0@lo:400:kworker.0 00000100:00100000:2.0:1788869862.744251:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325220480:0@lo:8:kworker.0 00000100:00100000:2.0:1788869862.744292:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869862.744344:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325220096 00000100:00100000:2.0:1788869862.744353:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325220096 00000100:00100000:2.0:1788869862.744397:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869862.744406:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875765325220096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869862.744438:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788869862.744494:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875765325220096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869862.744501:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788869862.744522:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325219712 00000100:00100000:2.0:1788869862.744526:0:24176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325219712 00000100:00100000:2.0:1788869862.744545:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325220480 00000100:00100000:2.0:1788869862.744548:0:24176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325220480 00000100:00100000:2.0:1788869862.744558:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869862.744564:0:24176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325219712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869862.744619:0:24176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325219712:12345-0@lo:400:kworker.0 Request processed in 55us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869862.744625:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788869862.744638:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788869862.744642:0:24176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875765325220480:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788869862.744673:0:24176:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 796 last 0 00000020:00000080:2.0:1788869862.744704:0:24176:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4c16c38a9b6d0705 00002000:00100000:2.0:1788869862.744719:0:24176:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8e270351e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788869862.744723:0:24176:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1788869862.744726:0:24176:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788869862.744793:0:24176:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788869862.744827:0:24176:0:(import.c:65:import_set_state_nolock()) ffff8e270351a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869862.745019:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325219968 00000100:00100000:3.0:1788869862.745024:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325219968 00000100:00100000:3.0:1788869862.745067:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325220736 00000100:00100000:3.0:1788869862.745070:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325220736 00000100:00100000:3.0:1788869862.745101:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325220864 00000100:00100000:3.0:1788869862.745105:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325220864 00000100:00100000:3.0:1788869862.745117:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325220992 00000100:00100000:3.0:1788869862.745119:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325220992 00000100:00100000:3.0:1788869862.745246:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788869862.745253:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325219968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869862.745312:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325220608:0@lo:400:kworker.0 00000100:00100000:2.0:1788869862.747194:0:24176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1875765325220480:12345-0@lo:8:kworker.0 Request processed in 2539us (2889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869862.747212:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00002000:00080000:2.0:1788869862.749253:0:24174:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788869862.749266:0:24174:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:2.0:1788869862.749273:0:24174:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00000100:00100000:3.0:1788869862.750014:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875765325219968:12345-0@lo:400:kworker.0 Request processed in 4754us (6589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869862.750030:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788869862.750077:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788869862.750112:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325220736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869862.750229:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325220736:12345-0@lo:400:kworker.0 Request processed in 125us (6748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869862.750235:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788869862.750248:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788869862.750256:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325220864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869862.750286:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875765325220864:12345-0@lo:400:kworker.0 Request processed in 32us (6638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869862.750292:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788869862.750306:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788869862.750312:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325220992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869862.750341:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325220992:12345-0@lo:400:kworker.0 Request processed in 29us (6547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869862.750347:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788869862.757208:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869862.757269:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325221120:0@lo:400:kworker.0 00000100:00100000:0.0:1788869862.757310:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788869862.757352:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f045c00 x1875765325220992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869862.757376:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325220992:0@lo:400:kworker.0 00000100:00100000:0.0:1788869862.757410:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325219712:0@lo:400:kworker.0 00000100:00100000:0.0:1788869862.757451:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325220608 00000100:00100000:0.0:1788869862.757457:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325220608 00000100:00100000:0.0:1788869862.757500:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325221120 00000100:00100000:0.0:1788869862.757503:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325221120 00000100:00100000:0.0:1788869862.757527:0:24506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788869862.757535:0:24506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325220608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869862.757609:0:24506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325220608:12345-0@lo:400:kworker.0 Request processed in 74us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869862.757616:0:24506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788869862.757633:0:24506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788869862.757640:0:24506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325221120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869862.757667:0:24506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325221120:12345-0@lo:400:kworker.0 Request processed in 28us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869862.757673:0:24506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788869862.757700:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325219584 00000100:00100000:0.0:1788869862.757704:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325219584 00000100:00100000:0.0:1788869862.757732:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325220352 00000100:00100000:0.0:1788869862.757735:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325220352 00000100:00100000:0.0:1788869862.757748:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788869862.757754:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325219584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869862.757786:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325219584:12345-0@lo:400:kworker.0 Request processed in 32us (14066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869862.757792:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788869862.757812:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788869862.757818:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325220352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869862.757848:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325220352:12345-0@lo:400:kworker.0 Request processed in 30us (14090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869862.757854:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1788869862.757884:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f044a80 x1875765325220608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869862.757894:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325220608:0@lo:400:kworker.0 00010000:00080000:0.0:1788869862.757903:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27039f3b80 x1875765325221120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869862.757911:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325221120:0@lo:400:kworker.0 00000100:00100000:0.0:1788869862.757922:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325219584:0@lo:400:kworker.0 00000100:00100000:0.0:1788869862.757931:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325220352:0@lo:400:kworker.0 00010000:00080000:0.0:1788869862.761039:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0be680 x1875765325220096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869862.761075:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325220096:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788869862.761102:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f044e00 x1875765325220864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869862.761112:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875765325220864:0@lo:400:kworker.0 00010000:00080000:0.0:1788869862.761132:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a33480 x1875765325219968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869862.761140:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875765325219968:0@lo:400:kworker.0 00010000:00080000:0.0:1788869862.761167:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f046300 x1875765325220736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869862.761175:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325220736:0@lo:400:kworker.0 00000004:00080000:0.0:1788869862.764728:0:22644:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00080000:0.0:1788869862.765251:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869862.765259:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788869862.765321:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f045f80 x1875765325220480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788869887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788869862.765342:0:3647:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788869862.765352:0:3647:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788869862.765357:0:3647:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788869862.765361:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8e27029d0800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788869862.765381:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788869862.765389:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875765325220480:0@lo:8:kworker.0 00000004:00080000:0.0:1788869862.765526:0:23410:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788869862.765551:0:23410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23410:1875765325221376:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788869862.765643:0:23410:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869862.765677:0:23410:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280b2b8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869862.765696:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325221248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869862.765723:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788869862.768476:0:23409:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788869862.768810:0:23409:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 796682222007ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788869862.768820:0:23409:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788869862.768866:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325221376 00000100:00100000:2.0:1788869862.768880:0:24176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325221376 00000100:00100000:2.0:1788869862.768943:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788869862.768955:0:24176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23410:x1875765325221376:12345-0@lo:7:osp-pre-1-1.0 00002000:00080000:2.0:1788869862.771570:0:24176:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788869862.771582:0:24176:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788869862.774872:0:24176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23410:x1875765325221376:12345-0@lo:7:osp-pre-1-1.0 Request processed in 5901us (9209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869862.774893:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788869862.774957:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325221248 00000100:00100000:2.0:1788869862.774969:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325221248 00000100:00100000:2.0:1788869862.775014:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788869862.775024:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875765325221248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788869862.775049:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788869862.775118:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875765325221248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (9393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869862.775133:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788869862.777405:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788869862.778650:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27039f3b80 x1875765325221248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788869878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869862.778738:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325221248:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788869862.778810:0:23410:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27039f2d80 x1875765325221376/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788869878 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869862.778821:0:23410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23410:1875765325221376:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788869862.778833:0:23410:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788869862.778874:0:23410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23410:1875765325221504:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788869862.778937:0:23410:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869862.778982:0:23410:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28088406c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869862.778999:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325221504 00000100:00100000:2.0:1788869862.779005:0:24175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325221504 00000100:00100000:2.0:1788869862.779049:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788869862.779059:0:24175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23410:x1875765325221504:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788869862.779093:0:24175:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1788869862.779135:0:24175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23410:x1875765325221504:12345-0@lo:5:osp-pre-1-1.0 Request processed in 77us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869862.779141:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788869862.779173:0:23410:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0bdc00 x1875765325221504/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788869878 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869862.779182:0:23410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23410:1875765325221504:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788869862.779196:0:23410:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788869862.779219:0:23410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23410:1875765325221632:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788869862.779241:0:23410:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869862.779269:0:23410:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28088406c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788869862.779282:0:24507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325221632 00000100:00100000:2.0:1788869862.779286:0:24507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325221632 00000100:00100000:2.0:1788869862.779306:0:24507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788869862.779312:0:24507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23410:x1875765325221632:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788869862.779336:0:24507:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000004:00080000:0.0:1788869862.779775:0:23398:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:0.0:1788869862.783034:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869862.783048:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6d070c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.783068:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1788869862.783103:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869862.783110:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6d070c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.783132:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6d070c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.783143:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6d070c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.783151:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6d070c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.783172:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788869862.784467:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869862.784480:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6d0713 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.784497:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1788869862.784501:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869862.784507:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6d0713 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.784520:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6d0713 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.784529:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6d0713 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.784545:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6d0713 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.784562:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788869862.784575:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869862.784581:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6d070c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.784617:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4e00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869862.784622:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6d070c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.784632:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6d070c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.784648:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6d070c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.784656:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6d070c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.784682:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869862.784686:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6d0713 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.784703:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4000 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869862.784706:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6d0713 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.784712:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6d0713 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.784722:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6d0713 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.784728:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6d0713 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.784739:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869862.784741:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869862.784743:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.785301:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869862.786939:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869862.786956:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c10e3874/0x4c16c38a9b6d071a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.786977:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1788869862.786982:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869862.786989:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c10e3874/0x4c16c38a9b6d071a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.787002:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c10e3874/0x4c16c38a9b6d071a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.787027:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c10e3874/0x4c16c38a9b6d071a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.787034:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c10e3874/0x4c16c38a9b6d071a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.787061:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869862.787344:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869862.787352:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c10e3874/0x4c16c38a9b6d071a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.787372:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869862.787378:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c10e3874/0x4c16c38a9b6d071a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.787387:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c10e3874/0x4c16c38a9b6d071a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.787410:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c10e3874/0x4c16c38a9b6d071a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.787418:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c10e3874/0x4c16c38a9b6d071a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.787439:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.787441:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.787443:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869862.788525:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869862.788538:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef45dd8a/0x4c16c38a9b6d0721 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.788553:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1788869862.788557:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869862.788563:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef45dd8a/0x4c16c38a9b6d0721 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.788576:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef45dd8a/0x4c16c38a9b6d0721 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.788611:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef45dd8a/0x4c16c38a9b6d0721 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.788619:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef45dd8a/0x4c16c38a9b6d0721 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.788650:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869862.788829:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869862.788836:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef45dd8a/0x4c16c38a9b6d0721 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.788844:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869862.788848:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef45dd8a/0x4c16c38a9b6d0721 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.788856:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef45dd8a/0x4c16c38a9b6d0721 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.788877:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef45dd8a/0x4c16c38a9b6d0721 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.788884:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef45dd8a/0x4c16c38a9b6d0721 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.788901:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.788903:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.788905:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869862.790450:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869862.790462:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a58032c/0x4c16c38a9b6d0728 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.790478:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1788869862.790483:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869862.790489:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a58032c/0x4c16c38a9b6d0728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.790505:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a58032c/0x4c16c38a9b6d0728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.790515:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a58032c/0x4c16c38a9b6d0728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.790524:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a58032c/0x4c16c38a9b6d0728 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.790583:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788869862.795390:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869862.795407:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b427361/0x4c16c38a9b6d072f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.795426:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1788869862.795440:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869862.795447:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b427361/0x4c16c38a9b6d072f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.795463:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b427361/0x4c16c38a9b6d072f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.795474:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b427361/0x4c16c38a9b6d072f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.795483:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b427361/0x4c16c38a9b6d072f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.799939:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788869862.799953:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a58032c/0x4c16c38a9b6d0728 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.799970:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869862.799975:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a58032c/0x4c16c38a9b6d0728 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.799988:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a58032c/0x4c16c38a9b6d0728 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.800014:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a58032c/0x4c16c38a9b6d0728 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.800023:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a58032c/0x4c16c38a9b6d0728 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.800065:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869862.800070:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b427361/0x4c16c38a9b6d072f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.800076:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5c00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869862.800088:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b427361/0x4c16c38a9b6d072f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.800096:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b427361/0x4c16c38a9b6d072f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.800107:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b427361/0x4c16c38a9b6d072f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.800115:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.800117:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.800119:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869862.801972:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788869862.801989:0:24174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b427361/0x4c16c38a9b6d072f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.802510:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869862.807510:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869862.807524:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005efe55ab/0x4c16c38a9b6d0736 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.807542:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1788869862.807548:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869862.807555:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005efe55ab/0x4c16c38a9b6d0736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.807569:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005efe55ab/0x4c16c38a9b6d0736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.807602:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005efe55ab/0x4c16c38a9b6d0736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.807611:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005efe55ab/0x4c16c38a9b6d0736 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.807629:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869862.809773:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869862.809790:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005efe55ab/0x4c16c38a9b6d0736 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.809806:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4800 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869862.809811:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005efe55ab/0x4c16c38a9b6d0736 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.809834:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005efe55ab/0x4c16c38a9b6d0736 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.809858:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005efe55ab/0x4c16c38a9b6d0736 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.809866:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005efe55ab/0x4c16c38a9b6d0736 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.809899:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.809901:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.809903:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869862.810689:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869862.810699:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2c92771/0x4c16c38a9b6d073d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.810713:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1788869862.810718:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869862.810724:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2c92771/0x4c16c38a9b6d073d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.810736:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2c92771/0x4c16c38a9b6d073d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.810746:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2c92771/0x4c16c38a9b6d073d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.810755:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2c92771/0x4c16c38a9b6d073d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.810791:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869862.811025:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869862.811032:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2c92771/0x4c16c38a9b6d073d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.811040:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb5400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869862.811045:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2c92771/0x4c16c38a9b6d073d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.811055:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2c92771/0x4c16c38a9b6d073d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.811068:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2c92771/0x4c16c38a9b6d073d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.811099:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2c92771/0x4c16c38a9b6d073d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.811120:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.811122:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.811124:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788869862.812272:0:24990:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1788869862.812306:0:24990:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788869862.812311:0:24990:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788869862.814480:0:24507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23410:x1875765325221632:12345-0@lo:5:osp-pre-1-1.0 Request processed in 35152us (35222us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788869862.814500:0:24507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00002000:00010000:1.0:1788869862.815045:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869862.815060:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000651ffc74/0x4c16c38a9b6d0744 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.815092:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=796s v=(0 0) 00010000:00010000:1.0:1788869862.815097:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869862.815105:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000651ffc74/0x4c16c38a9b6d0744 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.815122:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000651ffc74/0x4c16c38a9b6d0744 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.815133:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000651ffc74/0x4c16c38a9b6d0744 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.815141:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000651ffc74/0x4c16c38a9b6d0744 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.815178:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869862.815741:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869862.815748:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000651ffc74/0x4c16c38a9b6d0744 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.815757:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edaa00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869862.815762:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000651ffc74/0x4c16c38a9b6d0744 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.815772:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000651ffc74/0x4c16c38a9b6d0744 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.815794:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000651ffc74/0x4c16c38a9b6d0744 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.815802:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000651ffc74/0x4c16c38a9b6d0744 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.815823:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869862.815825:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869862.815826:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869862.815882:0:23410:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788869862.815893:0:23410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23410:1875765325221632:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788869862.815917:0:23410:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1788869862.815972:0:23410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23410:1875765325221760:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788869862.816032:0:23410:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869862.816094:0:23410:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28088406c0 going to sleep for 11 seconds 00002000:00010000:1.0:1788869862.817834:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788869862.817847:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005203b1be/0x4c16c38a9b6d074b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.817864:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=796s v=(0 0) 00010000:00010000:1.0:1788869862.817868:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869862.817874:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005203b1be/0x4c16c38a9b6d074b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.817889:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005203b1be/0x4c16c38a9b6d074b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.817899:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005203b1be/0x4c16c38a9b6d074b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.817907:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005203b1be/0x4c16c38a9b6d074b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.817931:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869862.817946:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869862.817953:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005203b1be/0x4c16c38a9b6d074b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.817961:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edbe00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869862.817974:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005203b1be/0x4c16c38a9b6d074b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.817983:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005203b1be/0x4c16c38a9b6d074b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.818000:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005203b1be/0x4c16c38a9b6d074b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.818007:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005203b1be/0x4c16c38a9b6d074b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.818028:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.818030:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.818032:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869862.818492:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325221760 00000100:00100000:0.0:1788869862.818510:0:22676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325221760 00000100:00100000:0.0:1788869862.818579:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788869862.818607:0:22676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23410:x1875765325221760:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788869862.818708:0:22676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23410:x1875765325221760:12345-0@lo:900:osp-pre-1-1.0 Request processed in 103us (2676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869862.818715:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788869862.818763:0:23410:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f0bdc00 x1875765325221760/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788869878 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869862.818777:0:23410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23410:1875765325221760:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1788869862.819148:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869862.819156:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d0752 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.819168:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1788869862.819172:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869862.819176:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d0752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.819188:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d0752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.819196:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d0752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.819205:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d0752 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.819236:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788869862.820132:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869862.820142:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6d0759 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.820154:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1788869862.820157:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869862.820161:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6d0759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.820171:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6d0759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.820178:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6d0759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.820186:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6d0759 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.820256:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788869862.821161:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869862.821171:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6d0760 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.821182:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1788869862.821196:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869862.821201:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6d0760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.821213:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6d0760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.821223:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6d0760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.821231:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6d0760 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.824855:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788869862.824872:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d0752 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.824887:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4c00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869862.824892:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d0752 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.824903:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d0752 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.824947:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d0752 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.824955:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000881f9cc0/0x4c16c38a9b6d0752 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.824988:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869862.824992:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6d0759 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.824998:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4000 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869862.825002:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6d0759 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.825009:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6d0759 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.825018:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6d0759 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.825024:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002593f83/0x4c16c38a9b6d0759 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.825035:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869862.825039:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6d0760 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.825052:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4e00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869862.825055:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6d0760 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.825061:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6d0760 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.825071:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6d0760 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.825088:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869862.825090:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869862.825092:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.825465:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869862.825540:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788869862.825549:0:24174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000021e8156/0x4c16c38a9b6d0760 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.825739:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869862.826228:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869862.826238:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ad331d5/0x4c16c38a9b6d0767 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.826253:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1788869862.826258:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869862.826265:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ad331d5/0x4c16c38a9b6d0767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.826278:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ad331d5/0x4c16c38a9b6d0767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.826295:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ad331d5/0x4c16c38a9b6d0767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.826302:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ad331d5/0x4c16c38a9b6d0767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.826366:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788869862.828907:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869862.828923:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024c30469/0x4c16c38a9b6d076e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.828943:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1788869862.828949:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869862.828956:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024c30469/0x4c16c38a9b6d076e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.828971:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024c30469/0x4c16c38a9b6d076e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.828980:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024c30469/0x4c16c38a9b6d076e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.828987:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024c30469/0x4c16c38a9b6d076e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.830938:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788869862.830953:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ad331d5/0x4c16c38a9b6d0767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.830970:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800031000 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869862.830975:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ad331d5/0x4c16c38a9b6d0767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.830987:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ad331d5/0x4c16c38a9b6d0767 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.831028:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ad331d5/0x4c16c38a9b6d0767 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.831036:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ad331d5/0x4c16c38a9b6d0767 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.831060:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869862.831064:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024c30469/0x4c16c38a9b6d076e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.831071:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800031600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869862.831074:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024c30469/0x4c16c38a9b6d076e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.831094:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024c30469/0x4c16c38a9b6d076e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.831104:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024c30469/0x4c16c38a9b6d076e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.831111:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.831112:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.831115:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869862.831204:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788869862.831211:0:24174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024c30469/0x4c16c38a9b6d076e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.831957:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869862.832146:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869862.832153:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b0bb3f/0x4c16c38a9b6d0775 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.832167:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1788869862.832171:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869862.832177:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b0bb3f/0x4c16c38a9b6d0775 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.832191:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2b0bb3f/0x4c16c38a9b6d0775 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.832199:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2b0bb3f/0x4c16c38a9b6d0775 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.832208:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2b0bb3f/0x4c16c38a9b6d0775 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.832230:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788869862.832645:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869862.832650:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000791309f1/0x4c16c38a9b6d077c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.832674:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1788869862.832678:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869862.832682:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000791309f1/0x4c16c38a9b6d077c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.832692:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000791309f1/0x4c16c38a9b6d077c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.832700:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000791309f1/0x4c16c38a9b6d077c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.832708:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000791309f1/0x4c16c38a9b6d077c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.832720:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788869862.832993:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788869862.833003:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2b0bb3f/0x4c16c38a9b6d0775 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.833017:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800031800 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869862.833021:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b0bb3f/0x4c16c38a9b6d0775 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.833031:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2b0bb3f/0x4c16c38a9b6d0775 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.833048:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2b0bb3f/0x4c16c38a9b6d0775 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.833056:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2b0bb3f/0x4c16c38a9b6d0775 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.833077:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869862.833092:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000791309f1/0x4c16c38a9b6d077c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.833098:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800030400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869862.833101:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000791309f1/0x4c16c38a9b6d077c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.833109:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000791309f1/0x4c16c38a9b6d077c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.833119:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000791309f1/0x4c16c38a9b6d077c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.833132:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000791309f1/0x4c16c38a9b6d077c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.833146:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.833148:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.833150:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.833156:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869862.833415:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869862.833420:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040788dfb/0x4c16c38a9b6d0783 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.833429:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1788869862.833432:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869862.833436:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040788dfb/0x4c16c38a9b6d0783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.833445:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040788dfb/0x4c16c38a9b6d0783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.833463:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040788dfb/0x4c16c38a9b6d0783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.833470:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040788dfb/0x4c16c38a9b6d0783 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.833489:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869862.833821:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869862.833827:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040788dfb/0x4c16c38a9b6d0783 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.833834:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800031400 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869862.833838:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040788dfb/0x4c16c38a9b6d0783 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.833846:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040788dfb/0x4c16c38a9b6d0783 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.833858:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040788dfb/0x4c16c38a9b6d0783 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.833866:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040788dfb/0x4c16c38a9b6d0783 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.833881:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.833883:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.833891:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869862.834028:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869862.834034:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081ef8732/0x4c16c38a9b6d078a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.834044:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1788869862.834047:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869862.834052:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081ef8732/0x4c16c38a9b6d078a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.834061:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081ef8732/0x4c16c38a9b6d078a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.834068:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081ef8732/0x4c16c38a9b6d078a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.834076:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081ef8732/0x4c16c38a9b6d078a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.834118:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869862.834357:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869862.834363:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081ef8732/0x4c16c38a9b6d078a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.834371:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800030800 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869862.834374:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081ef8732/0x4c16c38a9b6d078a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.834381:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081ef8732/0x4c16c38a9b6d078a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.834392:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081ef8732/0x4c16c38a9b6d078a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.834398:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081ef8732/0x4c16c38a9b6d078a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.834412:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.834414:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.834416:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788869862.834490:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869862.834496:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e316dec/0x4c16c38a9b6d0791 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.834505:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1788869862.834508:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869862.834511:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e316dec/0x4c16c38a9b6d0791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.834520:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e316dec/0x4c16c38a9b6d0791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.834528:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e316dec/0x4c16c38a9b6d0791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.834534:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e316dec/0x4c16c38a9b6d0791 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.834552:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788869862.834919:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869862.834925:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008295f894/0x4c16c38a9b6d0798 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.834935:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1788869862.834943:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869862.834947:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008295f894/0x4c16c38a9b6d0798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.834957:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008295f894/0x4c16c38a9b6d0798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.834965:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008295f894/0x4c16c38a9b6d0798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.834973:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008295f894/0x4c16c38a9b6d0798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.835039:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788869862.839546:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788869862.839563:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b78607b/0x4c16c38a9b6d079f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.839581:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=796s v=(0 0) 00010000:00010000:0.0:1788869862.839611:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869862.839618:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b78607b/0x4c16c38a9b6d079f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.839633:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b78607b/0x4c16c38a9b6d079f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.839645:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b78607b/0x4c16c38a9b6d079f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.839717:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b78607b/0x4c16c38a9b6d079f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.839813:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788869862.839822:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e316dec/0x4c16c38a9b6d0791 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.839831:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800030000 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869862.839835:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e316dec/0x4c16c38a9b6d0791 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.839845:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e316dec/0x4c16c38a9b6d0791 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.839867:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e316dec/0x4c16c38a9b6d0791 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.839882:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e316dec/0x4c16c38a9b6d0791 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.839918:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869862.839923:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008295f894/0x4c16c38a9b6d0798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.839930:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800030c00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869862.839935:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008295f894/0x4c16c38a9b6d0798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.839943:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008295f894/0x4c16c38a9b6d0798 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.839954:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008295f894/0x4c16c38a9b6d0798 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.839961:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008295f894/0x4c16c38a9b6d0798 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.839974:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869862.839979:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b78607b/0x4c16c38a9b6d079f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.839985:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800031a00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869862.839995:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b78607b/0x4c16c38a9b6d079f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.840002:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b78607b/0x4c16c38a9b6d079f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.840013:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b78607b/0x4c16c38a9b6d079f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.840022:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869862.840023:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869862.840025:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.845231:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869862.846876:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788869862.846897:0:24174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b78607b/0x4c16c38a9b6d079f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.847471:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869862.855965:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869862.855987:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6d07a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869862.856008:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=796s v=(0 0) 00010000:00010000:2.0:1788869862.856013:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869862.856020:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6d07a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869862.856039:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6d07a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869862.856052:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6d07a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869862.856072:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6d07a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869862.856112:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788869862.857107:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869862.857116:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a9157c8/0x4c16c38a9b6d07ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869862.857130:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=796s v=(0 0) 00010000:00010000:2.0:1788869862.857134:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869862.857138:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a9157c8/0x4c16c38a9b6d07ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869862.857150:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a9157c8/0x4c16c38a9b6d07ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869862.857159:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a9157c8/0x4c16c38a9b6d07ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869862.857167:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a9157c8/0x4c16c38a9b6d07ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869862.857194:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788869862.857618:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788869862.857628:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6d07a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.857637:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6e00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869862.857642:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6d07a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.857652:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6d07a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.857790:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1788869862.858100:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869862.858108:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a310777/0x4c16c38a9b6d07b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869862.858124:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=796s v=(0 0) 00010000:00010000:2.0:1788869862.858127:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869862.858132:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a310777/0x4c16c38a9b6d07b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869862.858143:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a310777/0x4c16c38a9b6d07b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869862.858152:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a310777/0x4c16c38a9b6d07b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869862.858160:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a310777/0x4c16c38a9b6d07b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869862.858171:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869862.858460:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6d07a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.858468:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e9f4c3c/0x4c16c38a9b6d07a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.858510:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869862.858514:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a310777/0x4c16c38a9b6d07b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.858520:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869862.858524:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a310777/0x4c16c38a9b6d07b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.858532:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a310777/0x4c16c38a9b6d07b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.858542:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a310777/0x4c16c38a9b6d07b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.858549:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a310777/0x4c16c38a9b6d07b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.858561:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869862.858562:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869862.858564:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788869862.858710:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788869862.858716:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6d07bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869862.858724:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=796s v=(0 0) 00010000:00010000:2.0:1788869862.858727:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788869862.858731:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6d07bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869862.858742:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6d07bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869862.858761:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6d07bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869862.858768:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6d07bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869862.858785:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788869862.858936:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788869862.858941:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6d07bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.858948:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d7a00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869862.858958:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6d07bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.858966:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6d07bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.858978:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6d07bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.858986:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee8b2e0f/0x4c16c38a9b6d07bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.859002:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869862.859004:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788869862.859006:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869862.866918:0:25255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869862.866927:0:25255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869862.866929:0:25255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869862.867350:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869862.867362:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009320fe2/0x4c16c38a9b6d07c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.867380:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=796s v=(0 0) 00010000:00010000:3.0:1788869862.867385:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869862.867392:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009320fe2/0x4c16c38a9b6d07c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.867406:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009320fe2/0x4c16c38a9b6d07c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.867417:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009320fe2/0x4c16c38a9b6d07c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.867433:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009320fe2/0x4c16c38a9b6d07c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.867458:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788869862.867842:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a9157c8/0x4c16c38a9b6d07ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.867853:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6800 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869862.867858:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9157c8/0x4c16c38a9b6d07ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.867874:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9157c8/0x4c16c38a9b6d07ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.867893:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a9157c8/0x4c16c38a9b6d07ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.867901:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a9157c8/0x4c16c38a9b6d07ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.867928:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788869862.867932:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009320fe2/0x4c16c38a9b6d07c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.867940:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7fc00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869862.867943:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009320fe2/0x4c16c38a9b6d07c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.867950:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009320fe2/0x4c16c38a9b6d07c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.867961:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009320fe2/0x4c16c38a9b6d07c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.867968:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009320fe2/0x4c16c38a9b6d07c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869862.867995:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.867996:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.867998:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869862.869792:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869862.870039:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869862.870049:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b7379de/0x4c16c38a9b6d07c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.870065:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=796s v=(0 0) 00010000:00010000:3.0:1788869862.870069:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869862.870075:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b7379de/0x4c16c38a9b6d07c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.870100:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b7379de/0x4c16c38a9b6d07c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.870110:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b7379de/0x4c16c38a9b6d07c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.870118:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b7379de/0x4c16c38a9b6d07c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.870138:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788869862.870552:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869862.870559:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6d07d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.870574:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=796s v=(0 0) 00010000:00010000:3.0:1788869862.870577:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869862.870581:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6d07d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.870615:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6d07d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.870623:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6d07d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.870630:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6d07d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.870653:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788869862.870964:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869862.870969:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d98b39d/0x4c16c38a9b6d07d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.870978:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=796s v=(0 0) 00010000:00010000:3.0:1788869862.870981:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869862.870985:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d98b39d/0x4c16c38a9b6d07d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.870995:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d98b39d/0x4c16c38a9b6d07d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.871014:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d98b39d/0x4c16c38a9b6d07d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.871022:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d98b39d/0x4c16c38a9b6d07d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.871035:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788869862.871331:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788869862.871340:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b7379de/0x4c16c38a9b6d07c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.871350:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869862.871355:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b7379de/0x4c16c38a9b6d07c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.871365:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b7379de/0x4c16c38a9b6d07c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.871384:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b7379de/0x4c16c38a9b6d07c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.871392:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b7379de/0x4c16c38a9b6d07c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.871426:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788869862.871430:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6d07d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.871436:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f000 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869862.871439:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6d07d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.871446:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6d07d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.871455:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6d07d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.871461:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003219774a/0x4c16c38a9b6d07d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.871472:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869862.871475:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d98b39d/0x4c16c38a9b6d07d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.871480:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e200 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869862.871483:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d98b39d/0x4c16c38a9b6d07d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.871500:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d98b39d/0x4c16c38a9b6d07d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.871510:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d98b39d/0x4c16c38a9b6d07d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.871518:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d98b39d/0x4c16c38a9b6d07d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.871532:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869862.871534:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869862.871536:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869862.871766:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869862.871915:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869862.871922:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000206f86c1/0x4c16c38a9b6d07de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.871932:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=796s v=(0 0) 00010000:00010000:3.0:1788869862.871936:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869862.871941:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000206f86c1/0x4c16c38a9b6d07de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.871952:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000206f86c1/0x4c16c38a9b6d07de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.871960:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000206f86c1/0x4c16c38a9b6d07de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.871968:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000206f86c1/0x4c16c38a9b6d07de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.872000:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788869862.872267:0:22653:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869862.872273:0:22653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000206f86c1/0x4c16c38a9b6d07de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.872282:0:22653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7fa00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869862.872286:0:22653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000206f86c1/0x4c16c38a9b6d07de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.872293:0:22653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000206f86c1/0x4c16c38a9b6d07de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.872308:0:22653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000206f86c1/0x4c16c38a9b6d07de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.872327:0:22653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000206f86c1/0x4c16c38a9b6d07de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.872341:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869862.872343:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869862.872345:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788869862.872421:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788869862.872426:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095b0c73d/0x4c16c38a9b6d07e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.872436:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=796s v=(0 0) 00010000:00010000:3.0:1788869862.872438:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869862.872442:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095b0c73d/0x4c16c38a9b6d07e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.872453:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095b0c73d/0x4c16c38a9b6d07e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.872462:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095b0c73d/0x4c16c38a9b6d07e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.872469:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095b0c73d/0x4c16c38a9b6d07e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869862.872522:0:24174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788869862.872813:0:24174:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1788869862.872941:0:24174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22691:x1875765325220224:12345-0@lo:5:osp-pre-1-0.0 Request processed in 132528us (133896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869862.872953:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869862.873025:0:22691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22691:1875765325220224:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788869862.873049:0:22691:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1788869862.873113:0:22691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841001880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22691:1875765325221888:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788869862.873150:0:22691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869862.873175:0:22691:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e282db7f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788869862.873196:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325221888 00000100:00100000:3.0:1788869862.873203:0:24176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325221888 00000100:00100000:3.0:1788869862.873246:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788869862.873254:0:24176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841002300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22691:x1875765325221888:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788869862.873290:0:24176:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:3.0:1788869862.878513:0:24176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841002300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22691:x1875765325221888:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5250us (5352us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788869862.878526:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788869862.878636:0:22691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841001880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22691:1875765325221888:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788869862.878654:0:22691:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:0.0:1788869862.878913:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788869862.878922:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095b0c73d/0x4c16c38a9b6d07e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.878937:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f800 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:0.0:1788869862.878943:0:22652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095b0c73d/0x4c16c38a9b6d07e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.878956:0:22652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095b0c73d/0x4c16c38a9b6d07e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.878978:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095b0c73d/0x4c16c38a9b6d07e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.878986:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095b0c73d/0x4c16c38a9b6d07e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869862.879009:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869862.879011:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869862.879013:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869862.880477:0:25255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869863.240035:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325222016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869863.240142:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869863.240231:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325222016 00000100:00100000:2.0:1788869863.240239:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325222016 00000100:00100000:2.0:1788869863.240292:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788869863.240300:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325222016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869863.240335:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788869863.240429:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325222016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869863.240436:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788869863.240483:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325222016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869863.241064:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869863.244835:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270340ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325222144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869863.245012:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869863.245138:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325222144 00000100:00100000:2.0:1788869863.245150:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325222144 00000100:00100000:2.0:1788869863.245212:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788869863.245232:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325222144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869863.245271:0:23407:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788869863.245339:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325222144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869863.245351:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788869863.246511:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270340ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325222144:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788869863.366050:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788869864.071141:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788869864.389960:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869864.495236:0:25347:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg454-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788869865.414249:0:25255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788869865.682128:0:25399:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869865.682439:0:25399:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788869866.309747:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869866.309774:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325222272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788869866.309849:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869866.309897:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325222272 00000100:00100000:0.0:1788869866.309905:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325222272 00000100:00100000:0.0:1788869866.309970:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869866.309979:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325222272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869866.310027:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788869866.310074:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325222272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869866.310093:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788869866.310146:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325222272:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788869866.310578:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788869866.439016:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788869866.785210:0:25450:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788869866.786359:0:25450:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1788869867.017232:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788869867.200712:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869867.200835:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305169152 00000100:00100000:0.0:1788869867.200848:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305169152 00000100:00100000:0.0:1788869867.200904:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:0.0:1788869867.200913:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2406:x1875765305169152:12345-192.168.204.54@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788869867.200943:0:22657:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 2d6460b5-31e2-4371-a5e1-fc7d3e14d226@192.168.204.54@tcp t0 exp 0000000000000000 cur 801 last 0 00000020:00000080:0.0:1788869867.200976:0:22657:0:(genops.c:1384:class_connect()) connect: client 2d6460b5-31e2-4371-a5e1-fc7d3e14d226, cookie 0x4c16c38a9b6d07ec 00000100:00080000:0.0:1788869867.201158:0:22657:0:(import.c:65:import_set_state_nolock()) ffff8e270265e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788869867.201238:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+5:2406:x1875765305169152:12345-192.168.204.54@tcp:250:mount.lustre.0 Request processed in 324us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869867.201246:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 116 00000100:00100000:0.0:1788869867.229723:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869867.229851:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305169280 00000100:00100000:2.0:1788869867.229862:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305169280 00000100:00100000:2.0:1788869867.229932:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:2.0:1788869867.229942:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+5:18112:x1875765305169280:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788869867.229960:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869867.229978:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28029d7e00/0x4c16c38a9b6d07f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca34c expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869867.230017:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28029d7e00/0x4c16c38a9b6d07f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca34c expref: 6 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869867.230029:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28029d7e00/0x4c16c38a9b6d07f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca34c expref: 6 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869867.230038:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d7e00, rc 0) 00000100:00100000:2.0:1788869867.230104:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+6:18112:x1875765305169280:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 162us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869867.230112:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 117 00000100:00100000:3.0:1788869867.241397:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869867.243385:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305169408 00000100:00100000:2.0:1788869867.243400:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305169408 00000100:00100000:2.0:1788869867.243473:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:2.0:1788869867.243485:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+6:18112:x1875765305169408:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788869867.243665:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+6:18112:x1875765305169408:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 182us (2280us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788869867.243673:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 118 00000100:00100000:1.0:1788869867.246666:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869867.246764:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305169536 00000100:00100000:0.0:1788869867.246787:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305169536 00000100:00100000:0.0:1788869867.246852:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:0.0:1788869867.246863:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+6:18112:x1875765305169536:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788869867.246881:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869867.246899:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2800031400/0x4c16c38a9b6d07fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca353 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869867.246946:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2800031400/0x4c16c38a9b6d07fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca353 expref: 7 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869867.246959:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2800031400/0x4c16c38a9b6d07fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca353 expref: 7 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869867.246991:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2800031400, rc 0) 00000100:00100000:0.0:1788869867.247053:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+7:18112:x1875765305169536:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 192us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869867.247061:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 119 00000100:00100000:0.0:1788869867.249559:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869867.249646:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305169664 00000100:00100000:3.0:1788869867.249658:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305169664 00000100:00100000:3.0:1788869867.249717:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:3.0:1788869867.249728:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+7:18112:x1875765305169664:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788869867.249911:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+8:18112:x1875765305169664:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 186us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869867.249935:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 120 00000100:00100000:3.0:1788869867.252520:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869867.259706:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305169792 00000100:00100000:2.0:1788869867.259724:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305169792 00000100:00100000:2.0:1788869867.259807:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:2.0:1788869867.259819:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+8:18112:x1875765305169792:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788869867.260047:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+8:18112:x1875765305169792:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 230us (7536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869867.260056:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 121 00000100:00100000:1.0:1788869867.280650:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869867.280812:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305169920 00000100:00100000:0.0:1788869867.280823:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305169920 00000100:00100000:0.0:1788869867.280893:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:0.0:1788869867.280904:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+8:18131:x1875765305169920:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788869867.281110:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+8:18131:x1875765305169920:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 207us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869867.281119:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 122 00000100:00100000:3.0:1788869867.333936:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788869867.333966:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325222400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869867.334056:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869867.335201:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325222400 00000100:00100000:1.0:1788869867.335213:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325222400 00000100:00100000:1.0:1788869867.335303:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869867.335315:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841002680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325222400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869867.335341:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00080000:2.0:1788869867.335528:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869867.336266:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841002680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325222400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 952us (2207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869867.336278:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788869867.336701:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325222400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869867.348922:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869867.349022:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305170048 00000100:00100000:3.0:1788869867.349034:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305170048 00000100:00100000:3.0:1788869867.349108:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:3.0:1788869867.349119:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+8:18131:x1875765305170048:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788869867.349307:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+8:18131:x1875765305170048:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 189us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869867.349315:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 123 00000100:00100000:0.0:1788869867.354483:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869867.354778:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305170176 00000100:00100000:2.0:1788869867.354790:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305170176 00000100:00100000:2.0:1788869867.354841:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:2.0:1788869867.354851:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+8:18131:x1875765305170176:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869867.355041:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+8:18131:x1875765305170176:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 190us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869867.355050:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 124 00000100:00100000:1.0:1788869867.372312:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869867.372520:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305170304 00000100:00100000:0.0:1788869867.372532:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305170304 00000100:00100000:0.0:1788869867.372694:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 125 00000100:00100000:0.0:1788869867.372705:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+8:18112:x1875765305170304:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788869867.372724:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869867.372744:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2800030c00/0x4c16c38a9b6d0801 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca384 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869867.372776:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2800030c00/0x4c16c38a9b6d0801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca384 expref: 9 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869867.372787:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2800030c00/0x4c16c38a9b6d0801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca384 expref: 9 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869867.372796:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2800030c00, rc 0) 00000100:00100000:0.0:1788869867.372860:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+9:18112:x1875765305170304:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 157us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869867.372868:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 125 00000100:00100000:0.0:1788869867.399619:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869867.399780:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305170432 00000100:00100000:3.0:1788869867.399790:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305170432 00000100:00100000:3.0:1788869867.399859:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:3.0:1788869867.399872:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+9:18112:x1875765305170432:12345-192.168.204.54@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788869867.399904:0:22659:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788869867.399932:0:22659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788869867.399937:0:22659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788869867.399940:0:22659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788869867.399943:0:22659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788869867.399946:0:22659:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788869867.413336:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+9:18112:x1875765305170432:12345-192.168.204.54@tcp:256:mount.lustre.0 Request processed in 13455us (13742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869867.413351:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 126 00000100:00100000:1.0:1788869867.432469:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869867.432755:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305170560 00000100:00100000:2.0:1788869867.432764:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305170560 00000100:00100000:2.0:1788869867.432821:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00100000:2.0:1788869867.432830:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283c86c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+9:18112:x1875765305170560:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788869867.432848:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869867.432866:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6d0808 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca38b expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869867.432897:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6d0808 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca38b expref: 10 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869867.432909:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6d0808 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca38b expref: 10 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869867.432917:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6e00, rc 0) 00000100:00100000:2.0:1788869867.432988:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283c86c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+10:18112:x1875765305170560:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 149us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869867.432995:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 127 00000100:00100000:0.0:1788869867.461323:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869867.461549:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305170688 00000100:00100000:2.0:1788869867.461569:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305170688 00000100:00100000:2.0:1788869867.461679:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 128 00000100:00100000:2.0:1788869867.461691:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805cbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+10:18112:x1875765305170688:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788869867.461922:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805cbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+10:18112:x1875765305170688:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 232us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869867.461930:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 128 00010000:00010000:0.0:1788869867.462253:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869867.470914:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869867.471173:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305170816 00000100:00100000:0.0:1788869867.471186:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305170816 00000100:00100000:0.0:1788869867.471322:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 129 00000100:00100000:0.0:1788869867.471334:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805cbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+10:18112:x1875765305170816:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788869867.471525:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805cbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+10:18112:x1875765305170816:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 192us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869867.471534:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 129 00000100:00100000:1.0:1788869867.476932:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869867.477862:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305170944 00000100:00100000:2.0:1788869867.477875:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305170944 00000100:00100000:2.0:1788869867.477943:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 130 00000100:00100000:2.0:1788869867.477952:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805cbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+10:18136:x1875765305170944:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869867.478155:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805cbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+10:18136:x1875765305170944:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 203us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869867.478164:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 130 00000100:00100000:0.0:1788869867.489519:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869867.490179:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305171072 00000100:00100000:2.0:1788869867.490193:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305171072 00000100:00100000:2.0:1788869867.490260:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 131 00000100:00100000:2.0:1788869867.490271:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+10:18136:x1875765305171072:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869867.490469:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+10:18136:x1875765305171072:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 199us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869867.490480:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 131 00000100:00100000:1.0:1788869867.516623:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869867.516731:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869867.516826:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305171200 00000100:00100000:3.0:1788869867.516853:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305171200 00000100:00100000:3.0:1788869867.516903:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305171456 00000100:00100000:3.0:1788869867.516906:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305171456 00000100:00100000:3.0:1788869867.516928:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:3.0:1788869867.516936:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270340f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1875765305171200:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788869867.516967:0:22664:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 96d468b1-a138-4403-9587-850a7665da93@192.168.204.54@tcp t0 exp 0000000000000000 cur 801 last 0 00000020:00000080:3.0:1788869867.517029:0:22664:0:(genops.c:1384:class_connect()) connect: client 96d468b1-a138-4403-9587-850a7665da93, cookie 0x4c16c38a9b6d080f 00000004:00100000:3.0:1788869867.517127:0:22664:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788869867.517351:0:22664:0:(import.c:65:import_set_state_nolock()) ffff8e2841fef800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869867.517426:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270340f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+6:2406:x1875765305171200:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 489us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869867.517435:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:3.0:1788869867.517455:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1788869867.517460:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270340e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1875765305171456:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788869867.517476:0:22664:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 96d468b1-a138-4403-9587-850a7665da93@192.168.204.54@tcp t0 exp 0000000000000000 cur 801 last 0 00000020:00000080:3.0:1788869867.517511:0:22664:0:(genops.c:1384:class_connect()) connect: client 96d468b1-a138-4403-9587-850a7665da93, cookie 0x4c16c38a9b6d0816 00000004:00100000:3.0:1788869867.517525:0:22664:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788869867.517820:0:22664:0:(import.c:65:import_set_state_nolock()) ffff8e282fe75800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869867.517848:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270340e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+6:2406:x1875765305171456:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 387us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869867.517855:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:1.0:1788869867.521721:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869867.521783:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869867.521892:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305171584 00000100:00100000:0.0:1788869867.521903:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305171584 00000100:00100000:0.0:1788869867.521995:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305171328 00000100:00100000:0.0:1788869867.522000:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305171328 00000100:00100000:0.0:1788869867.522028:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:0.0:1788869867.522039:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270340f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+6:0:x1875765305171584:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788869867.522097:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788869867.522197:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270340f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+6:0:x1875765305171584:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 159us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869867.522205:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:0.0:1788869867.522226:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:0.0:1788869867.522232:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270340f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+6:0:x1875765305171328:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788869867.522251:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788869867.522293:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270340f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+6:0:x1875765305171328:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 61us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869867.522300:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00080000:1.0:1788869867.522494:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869867.522499:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869867.536199:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869867.536396:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305171712 00000100:00100000:1.0:1788869867.536407:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305171712 00000100:00100000:1.0:1788869867.536482:0:24506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1788869867.536493:0:24506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+6:18112:x1875765305171712:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788869867.536530:0:24506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788869867.536666:0:24506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+6:18112:x1875765305171712:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 175us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869867.536673:0:24506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1788869867.543820:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869867.547207:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305171840 00000100:00100000:0.0:1788869867.547225:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305171840 00000100:00100000:0.0:1788869867.547317:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:0.0:1788869867.547329:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270340ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+6:18112:x1875765305171840:12345-192.168.204.54@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788869867.547448:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270340ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+6:18112:x1875765305171840:12345-192.168.204.54@tcp:40:mount.lustre.0 Request processed in 121us (3643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869867.547456:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:2.0:1788869867.571125:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869867.571182:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869867.571323:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869867.574003:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305172224 00000100:00100000:1.0:1788869867.574020:0:22676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305172224 00000100:00100000:1.0:1788869867.574107:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:1.0:1788869867.574126:0:22676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:96d468b1-a138-4403-9587-850a7665da93+6:18112:x1875765305172224:12345-192.168.204.54@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788869867.574218:0:22676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:96d468b1-a138-4403-9587-850a7665da93+6:18112:x1875765305172224:12345-192.168.204.54@tcp:900:mount.lustre.0 Request processed in 94us (2894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869867.574225:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:3.0:1788869867.577988:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305171968 00000100:00100000:3.0:1788869867.578006:0:24176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305171968 00000100:00100000:2.0:1788869867.578338:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869867.578499:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305172352 00000100:00100000:3.0:1788869867.578504:0:22667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305172352 00000100:00100000:3.0:1788869867.578678:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1788869867.578691:0:22667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96d468b1-a138-4403-9587-850a7665da93+6:18112:x1875765305172352:12345-192.168.204.54@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788869867.580542:0:22667:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1240us 00000100:00100000:1.0:1788869867.581717:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305172096 00000100:00100000:1.0:1788869867.581734:0:24175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305172096 00000100:00100000:1.0:1788869867.581770:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:1.0:1788869867.581780:0:24175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1875765305171968:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788869867.581820:0:24175:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 96d468b1-a138-4403-9587-850a7665da93@192.168.204.54@tcp t0 exp 0000000000000000 cur 801 last 0 00000020:00000080:1.0:1788869867.581855:0:24175:0:(genops.c:1384:class_connect()) connect: client 96d468b1-a138-4403-9587-850a7665da93, cookie 0x4c16c38a9b6d081d 00002000:00100000:1.0:1788869867.581869:0:24175:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 96d468b1-a138-4403-9587-850a7665da93/ffff8e2827a96000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788869867.581890:0:24175:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788869867.582127:0:24175:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788869867.582164:0:24175:0:(import.c:65:import_set_state_nolock()) ffff8e2704041000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869867.582240:0:24175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96d468b1-a138-4403-9587-850a7665da93+6:2406:x1875765305171968:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 460us (11137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869867.582249:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:1.0:1788869867.582267:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:1.0:1788869867.582272:0:24175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1875765305172096:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788869867.582288:0:24175:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 96d468b1-a138-4403-9587-850a7665da93@192.168.204.54@tcp t0 exp 0000000000000000 cur 801 last 0 00000020:00000080:1.0:1788869867.582304:0:24175:0:(genops.c:1384:class_connect()) connect: client 96d468b1-a138-4403-9587-850a7665da93, cookie 0x4c16c38a9b6d0824 00002000:00100000:1.0:1788869867.582309:0:24175:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 96d468b1-a138-4403-9587-850a7665da93/ffff8e2704041800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788869867.582321:0:24175:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788869867.582424:0:24175:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788869867.582440:0:24175:0:(import.c:65:import_set_state_nolock()) ffff8e2704040000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788869867.582463:0:24175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96d468b1-a138-4403-9587-850a7665da93+6:2406:x1875765305172096:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 190us (11281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869867.582470:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000004:00200000:3.0:1788869867.608039:0:22667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788869867.608203:0:22667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96d468b1-a138-4403-9587-850a7665da93+6:18112:x1875765305172352:12345-192.168.204.54@tcp:33:mount.lustre.0 Request processed in 29510us (29864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869867.608214:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:2.0:1788869867.845834:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325222528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869867.845907:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869867.846123:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325222528 00000100:00100000:0.0:1788869867.846148:0:24178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325222528 00000100:00100000:0.0:1788869867.846210:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788869867.846221:0:24178:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325222528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788869867.846250:0:24178:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788869867.846302:0:24178:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325222528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869867.846310:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788869867.846334:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869867.846446:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869867.846457:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270340dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325222656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869867.846490:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869867.846663:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325222656 00000100:00100000:0.0:1788869867.846668:0:24178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325222656 00000100:00100000:0.0:1788869867.846709:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788869867.846716:0:24178:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270340ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875765325222656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788869867.846726:0:24178:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788869867.846759:0:24178:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270340ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875765325222656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869867.846765:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788869867.846809:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270340dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325222656:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788869867.846916:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869867.847001:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325222528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869867.847419:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325222912:0@lo:400:kworker.0 00000100:00100000:3.0:1788869867.847464:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869867.847478:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3649:1875765325222784:0@lo:400:kworker.0 00000100:00100000:3.0:1788869867.847505:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325223424:0@lo:400:kworker.0 00000100:00100000:1.0:1788869867.847509:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869867.847531:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869867.847532:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325223296:0@lo:400:kworker.0 00000100:00100000:3.0:1788869867.847550:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325223936:0@lo:400:kworker.0 00000100:00100000:3.0:1788869867.847567:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869867.847568:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869867.847614:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788869867.847622:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325223040:0@lo:400:kworker.0 00000100:00100000:1.0:1788869867.847628:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875765325223808:0@lo:400:kworker.0 00000100:00100000:3.0:1788869867.847647:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869867.847662:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869867.847665:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325223552:0@lo:400:kworker.0 00000100:00100000:1.0:1788869867.847677:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788869867.847682:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325223168:0@lo:400:kworker.0 00000100:00100000:3.0:1788869867.847683:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869867.847701:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869867.847709:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325222784 00000100:00100000:3.0:1788869867.847714:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325222784 00000100:00100000:1.0:1788869867.847715:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765325223680:0@lo:400:kworker.0 00000100:00100000:1.0:1788869867.847732:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869867.847742:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788869867.847750:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:3649:x1875765325222784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869867.847750:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325223424 00000100:00100000:1.0:1788869867.847753:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325223424 00000100:00100000:1.0:1788869867.847773:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325223936 00000100:00100000:1.0:1788869867.847776:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325223936 00000100:00100000:3.0:1788869867.847789:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:3649:x1875765325222784:12345-0@lo:400:kworker.0 Request processed in 41us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869867.847795:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325223808 00000100:00100000:3.0:1788869867.847796:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788869867.847797:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325223808 00000100:00100000:1.0:1788869867.847807:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325223552 00000100:00100000:1.0:1788869867.847809:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325223552 00000100:00100000:1.0:1788869867.847819:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325223168 00000100:00100000:1.0:1788869867.847821:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325223168 00000100:00100000:3.0:1788869867.847823:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325223680 00000100:00100000:3.0:1788869867.847832:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325223680 00000100:00100000:1.0:1788869867.847833:0:24506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788869867.847838:0:24506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325223424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869867.847847:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788869867.847852:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325223936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869867.847873:0:24506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875765325223424:12345-0@lo:400:kworker.0 Request processed in 34us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869867.847874:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875765325223936:12345-0@lo:400:kworker.0 Request processed in 23us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869867.847879:0:24506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788869867.847881:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788869867.847891:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788869867.847896:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270340e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875765325223808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869867.847921:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270340e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875765325223808:12345-0@lo:400:kworker.0 Request processed in 24us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869867.847933:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325222912 00000100:00100000:0.0:1788869867.848033:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325222912 00000100:00100000:0.0:1788869867.848061:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325223296 00000100:00100000:0.0:1788869867.848064:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325223296 00000100:00100000:0.0:1788869867.848079:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788869867.848085:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325222912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869867.848119:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325222912:12345-0@lo:400:kworker.0 Request processed in 34us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869867.848125:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788869867.848137:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788869867.848150:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270340ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325223296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869867.848181:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270340ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325223296:12345-0@lo:400:kworker.0 Request processed in 31us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869867.848186:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788869867.848482:0:24506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788869867.848493:0:24506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325223552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869867.848526:0:24506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875765325223552:12345-0@lo:400:kworker.0 Request processed in 37us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869867.848533:0:24506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788869867.848555:0:24506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788869867.848561:0:24506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270340df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325223168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869867.849557:0:24506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270340df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325223168:12345-0@lo:400:kworker.0 Request processed in 987us (1846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869867.849569:0:24506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788869867.849848:0:24506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788869867.849864:0:24506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270340dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875765325223680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869867.849925:0:24506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270340dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875765325223680:12345-0@lo:400:kworker.0 Request processed in 68us (2190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869867.849931:0:24506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788869867.849987:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325223040 00000100:00100000:1.0:1788869867.849995:0:24175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325223040 00000100:00100000:1.0:1788869867.850120:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788869867.850129:0:24175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325223040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869867.850165:0:24175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325223040:12345-0@lo:400:kworker.0 Request processed in 39us (2517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869867.850172:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788869867.850201:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869867.850207:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869867.850288:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325223040:0@lo:400:kworker.0 00010000:00080000:1.0:1788869867.850307:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f045f80 x1875765325223552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869867.850317:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875765325223552:0@lo:400:kworker.0 00010000:00080000:1.0:1788869867.850332:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f044a80 x1875765325223936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869867.850361:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875765325223936:0@lo:400:kworker.0 00000100:00100000:1.0:1788869867.850377:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325222912:0@lo:400:kworker.0 00010000:00080000:1.0:1788869867.850389:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a30380 x1875765325223424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869867.850397:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875765325223424:0@lo:400:kworker.0 00010000:00080000:1.0:1788869867.850449:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27039f3b80 x1875765325223168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869867.850459:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325223168:0@lo:400:kworker.0 00010000:00080000:1.0:1788869867.850469:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f046300 x1875765325223680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869867.850476:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765325223680:0@lo:400:kworker.0 00000100:00100000:1.0:1788869867.850486:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3649:1875765325222784:0@lo:400:kworker.0 00000100:00100000:1.0:1788869867.850496:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325223296:0@lo:400:kworker.0 00010000:00080000:1.0:1788869867.850507:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e282f044e00 x1875765325223808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869867.850514:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875765325223808:0@lo:400:kworker.0 00000100:00100000:3.0:1788869867.855250:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788869867.899704:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869867.900397:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305172480 00000100:00100000:1.0:1788869867.900412:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305172480 00000100:00100000:1.0:1788869867.900492:0:24506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:1.0:1788869867.900503:0:24506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+6:18159:x1875765305172480:12345-192.168.204.54@tcp:101:mkdir.0 00010000:00010000:1.0:1788869867.900550:0:24506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869867.900578:0:24506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6d082b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca3bc expref: -99 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869867.900691:0:24506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0832 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869867.900705:0:24506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869867.900720:0:24506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869867.900773:0:24506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788869867.900778:0:24506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869867.900812:0:24506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869867.900837:0:24506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edae00/0x4c16c38a9b6d082b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca3bc expref: 8 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869867.900855:0:24506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0832 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca3bc expref: 7 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869867.900863:0:24506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ef8900) 00010000:00010000:1.0:1788869867.900866:0:24506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869867.900869:0:24506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edba00, rc 0) 00000100:00100000:1.0:1788869867.900930:0:24506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+7:18159:x1875765305172480:12345-192.168.204.54@tcp:101:mkdir.0 Request processed in 429us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869867.900938:0:24506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1788869868.359275:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788869868.360989:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869868.361028:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325224192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788869868.361121:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869868.361298:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325224192 00000100:00100000:1.0:1788869868.361307:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325224192 00000100:00100000:1.0:1788869868.361361:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788869868.361371:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325224192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869868.361409:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788869868.361457:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325224192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869868.361463:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788869868.362383:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325224192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869868.370267:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f0bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325224064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869868.370365:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869868.371065:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325224064 00000100:00100000:1.0:1788869868.371075:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325224064 00000100:00100000:1.0:1788869868.371136:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788869868.371147:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325224064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869868.371183:0:23407:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788869868.371263:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325224064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869868.371271:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788869868.371475:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f0bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325224064:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788869868.485979:0:25255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788869868.875721:0:24990:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 96d468b1-a138-4403-9587-850a7665da93 00000001:00080000:2.0:1788869868.875755:0:24990:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:1.0:1788869869.511794:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869869.900717:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869869.900955:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305172608 00000100:00100000:3.0:1788869869.900966:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305172608 00000100:00100000:3.0:1788869869.901041:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1788869869.901053:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96d468b1-a138-4403-9587-850a7665da93+7:18212:x1875765305172608:12345-192.168.204.54@tcp:41:lfs.0 00000004:00000024:3.0:1788869869.901096:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788869869.901212:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96d468b1-a138-4403-9587-850a7665da93+7:18212:x1875765305172608:12345-192.168.204.54@tcp:41:lfs.0 Request processed in 162us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869869.901221:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00080000:1.0:1788869869.901373:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869869.910130:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869869.910801:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305172736 00000100:00100000:0.0:1788869869.910816:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305172736 00000100:00100000:0.0:1788869869.910912:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1788869869.910937:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+6:18212:x1875765305172736:12345-192.168.204.54@tcp:41:lfs.0 00000004:00000024:0.0:1788869869.910980:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788869869.911082:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+6:18212:x1875765305172736:12345-192.168.204.54@tcp:41:lfs.0 Request processed in 160us (967us total) trans 0 rc 0/0 00000100:00080000:2.0:1788869869.911150:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788869869.921841:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869869.922050:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305172864 00000100:00100000:3.0:1788869869.922060:0:24178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305172864 00000100:00100000:3.0:1788869869.922145:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1788869869.922154:0:24178:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:96d468b1-a138-4403-9587-850a7665da93+6:18212:x1875765305172864:12345-192.168.204.54@tcp:13:lfs.0 00002000:00000024:3.0:1788869869.922189:0:24178:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788869869.922284:0:24178:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:96d468b1-a138-4403-9587-850a7665da93+6:18212:x1875765305172864:12345-192.168.204.54@tcp:13:lfs.0 Request processed in 131us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869869.922291:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00080000:2.0:1788869869.922503:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869869.928676:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:2.0:1788869869.933723:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869869.933879:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305172992 00000100:00100000:3.0:1788869869.933890:0:24178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305172992 00000100:00100000:3.0:1788869869.933984:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1788869869.933995:0:24178:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f0be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:96d468b1-a138-4403-9587-850a7665da93+5:18212:x1875765305172992:12345-192.168.204.54@tcp:13:lfs.0 00002000:00000024:3.0:1788869869.934223:0:24178:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788869869.934345:0:24178:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f0be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:96d468b1-a138-4403-9587-850a7665da93+5:18212:x1875765305172992:12345-192.168.204.54@tcp:13:lfs.0 Request processed in 351us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869869.934355:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00080000:2.0:1788869869.935626:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788869870.373501:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869870.373721:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305173120 00000100:00100000:0.0:1788869870.373739:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305173120 00000100:00100000:0.0:1788869870.373828:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00100000:0.0:1788869870.373841:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+10:18243:x1875765305173120:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788869870.373866:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869870.373893:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2800030400/0x4c16c38a9b6d0839 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca3c3 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869870.373941:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2800030400/0x4c16c38a9b6d0839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca3c3 expref: 11 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869870.373955:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2800030400/0x4c16c38a9b6d0839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca3c3 expref: 11 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869870.373985:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2800030400, rc 0) 00000100:00100000:0.0:1788869870.374057:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+11:18243:x1875765305173120:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 219us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869870.374064:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 133 00000100:00100000:0.0:1788869870.406573:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869870.413181:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305173248 00000100:00100000:2.0:1788869870.413201:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305173248 00000100:00100000:2.0:1788869870.413628:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 134 00000100:00100000:2.0:1788869870.413641:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+11:18243:x1875765305173248:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788869870.414000:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+11:18243:x1875765305173248:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 361us (7441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869870.414009:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 134 00000100:00100000:2.0:1788869870.422056:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869870.422431:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305173376 00000100:00100000:3.0:1788869870.422444:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305173376 00000100:00100000:3.0:1788869870.422520:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 135 00000100:00100000:3.0:1788869870.422532:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+11:18243:x1875765305173376:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788869870.422745:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+11:18243:x1875765305173376:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 214us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869870.422754:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 135 00000100:00100000:3.0:1788869870.445112:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869870.448877:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305173504 00000100:00100000:2.0:1788869870.448896:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305173504 00000100:00100000:2.0:1788869870.449005:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 136 00000100:00100000:2.0:1788869870.449018:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+11:18251:x1875765305173504:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869870.449247:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+11:18251:x1875765305173504:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 230us (4144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869870.449256:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 136 00000100:00100000:0.0:1788869870.494569:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869870.495107:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305173632 00000100:00100000:2.0:1788869870.495120:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305173632 00000100:00100000:2.0:1788869870.495189:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:2.0:1788869870.495200:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+11:18251:x1875765305173632:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869870.495952:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+11:18251:x1875765305173632:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 751us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869870.495969:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 137 00000100:00100000:0.0:1788869870.513850:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869870.520199:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305173760 00000100:00100000:3.0:1788869870.520229:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305173760 00000100:00100000:3.0:1788869870.520350:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 138 00000100:00100000:3.0:1788869870.520389:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+11:18251:x1875765305173760:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788869870.520680:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+11:18251:x1875765305173760:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 295us (6847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869870.520690:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 138 00000100:00100000:0.0:1788869870.524719:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869870.524881:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305173888 00000100:00100000:2.0:1788869870.524898:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305173888 00000100:00100000:2.0:1788869870.525001:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 139 00000100:00100000:2.0:1788869870.525017:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+11:18243:x1875765305173888:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788869870.525042:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869870.525069:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28029d7a00/0x4c16c38a9b6d0840 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca3f4 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869870.525117:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28029d7a00/0x4c16c38a9b6d0840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca3f4 expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869870.525132:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28029d7a00/0x4c16c38a9b6d0840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca3f4 expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869870.525144:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d7a00, rc 0) 00000100:00100000:2.0:1788869870.525226:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+12:18243:x1875765305173888:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 213us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869870.525235:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 139 00010000:00010000:0.0:1788869870.534626:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869870.535944:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869870.536727:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305174016 00000100:00100000:2.0:1788869870.536743:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305174016 00000100:00100000:2.0:1788869870.536823:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 140 00000100:00100000:2.0:1788869870.536835:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+12:18243:x1875765305174016:12345-192.168.204.54@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788869870.536868:0:22659:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788869870.536903:0:22659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788869870.536920:0:22659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788869870.536923:0:22659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788869870.536933:0:22659:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788869870.536935:0:22659:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788869870.540858:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+12:18243:x1875765305174016:12345-192.168.204.54@tcp:256:mount.lustre.0 Request processed in 4002us (4904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869870.540881:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 140 00000100:00100000:0.0:1788869870.568247:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869870.568531:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305174144 00000100:00100000:3.0:1788869870.568546:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305174144 00000100:00100000:3.0:1788869870.568657:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 141 00000100:00100000:3.0:1788869870.568671:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+12:18243:x1875765305174144:12345-192.168.204.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788869870.568698:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869870.568731:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6d0847 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca3fb expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869870.568782:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6d0847 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca3fb expref: 13 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869870.568797:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6d0847 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca3fb expref: 13 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869870.568810:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e800, rc 0) 00000100:00100000:3.0:1788869870.568917:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:18243:x1875765305174144:12345-192.168.204.54@tcp:101:mount.lustre.0 Request processed in 238us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869870.568926:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 141 00000100:00100000:0.0:1788869870.577311:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869870.578186:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305174272 00000100:00100000:2.0:1788869870.578203:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305174272 00000100:00100000:2.0:1788869870.578299:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 142 00000100:00100000:2.0:1788869870.578312:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:18243:x1875765305174272:12345-192.168.204.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788869870.578845:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:18243:x1875765305174272:12345-192.168.204.54@tcp:501:mount.lustre.0 Request processed in 533us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869870.578856:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 142 00000100:00100000:2.0:1788869870.587190:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869870.587517:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305174400 00000100:00100000:0.0:1788869870.587532:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305174400 00000100:00100000:0.0:1788869870.587655:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 143 00000100:00100000:0.0:1788869870.587669:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:18243:x1875765305174400:12345-192.168.204.54@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788869870.587893:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:18243:x1875765305174400:12345-192.168.204.54@tcp:503:mount.lustre.0 Request processed in 226us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869870.587903:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 143 00000100:00100000:0.0:1788869870.599761:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869870.605178:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305174528 00000100:00100000:2.0:1788869870.605204:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305174528 00000100:00100000:2.0:1788869870.605322:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 144 00000100:00100000:2.0:1788869870.605335:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:18255:x1875765305174528:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788869870.605642:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:18255:x1875765305174528:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 307us (5896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869870.605653:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 144 00000100:00100000:1.0:1788869870.617242:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869870.617413:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305174656 00000100:00100000:3.0:1788869870.617427:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305174656 00000100:00100000:3.0:1788869870.617875:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 145 00000100:00100000:3.0:1788869870.617892:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:18255:x1875765305174656:12345-192.168.204.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788869870.618130:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:18255:x1875765305174656:12345-192.168.204.54@tcp:502:llog_process_th.0 Request processed in 243us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869870.618139:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 145 00000100:00100000:3.0:1788869870.637687:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869870.637807:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869870.638139:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305174784 00000100:00100000:2.0:1788869870.638153:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305174784 00000100:00100000:2.0:1788869870.638210:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305175040 00000100:00100000:2.0:1788869870.638213:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305175040 00000100:00100000:2.0:1788869870.638249:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1788869870.638259:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1875765305174784:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788869870.638310:0:22666:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e29a08ad-0316-4442-93c9-d46ea76b83fc@192.168.204.54@tcp t0 exp 0000000000000000 cur 804 last 0 00000020:00000080:2.0:1788869870.638562:0:22666:0:(genops.c:1384:class_connect()) connect: client e29a08ad-0316-4442-93c9-d46ea76b83fc, cookie 0x4c16c38a9b6d084e 00000004:00100000:2.0:1788869870.638633:0:22666:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788869870.638771:0:22666:0:(import.c:65:import_set_state_nolock()) ffff8e28130f6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869870.638879:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:2406:x1875765305174784:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 619us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869870.638888:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:2.0:1788869870.638927:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1788869870.638933:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1875765305175040:12345-192.168.204.54@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788869870.638954:0:22666:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from e29a08ad-0316-4442-93c9-d46ea76b83fc@192.168.204.54@tcp t0 exp 0000000000000000 cur 804 last 0 00000020:00000080:2.0:1788869870.638978:0:22666:0:(genops.c:1384:class_connect()) connect: client e29a08ad-0316-4442-93c9-d46ea76b83fc, cookie 0x4c16c38a9b6d0855 00000004:00100000:2.0:1788869870.640712:0:22666:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788869870.640877:0:22666:0:(import.c:65:import_set_state_nolock()) ffff8e2702585800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788869870.642323:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:2406:x1875765305175040:12345-192.168.204.54@tcp:38:mount.lustre.0 Request processed in 3372us (4499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869870.642341:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1788869870.656233:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869870.656289:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869870.656931:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869870.662791:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305175296 00000100:00100000:0.0:1788869870.662817:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305175296 00000100:00080000:0.0:1788869870.662878:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869870.662977:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305174912 00000100:00100000:0.0:1788869870.662982:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305174912 00000100:00100000:0.0:1788869870.663006:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305175168 00000100:00100000:0.0:1788869870.663026:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305175168 00000100:00100000:0.0:1788869870.663061:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:0.0:1788869870.663072:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e29a08ad-0316-4442-93c9-d46ea76b83fc+7:18243:x1875765305175296:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788869870.663133:0:23784:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788869870.663252:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e29a08ad-0316-4442-93c9-d46ea76b83fc+7:18243:x1875765305175296:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 180us (7035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869870.663265:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:3.0:1788869870.663936:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:3.0:1788869870.663956:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:0:x1875765305174912:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788869870.663983:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788869870.664034:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:0:x1875765305174912:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 86us (7744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869870.664040:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:0.0:1788869870.664112:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:0.0:1788869870.664131:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:0:x1875765305175168:12345-192.168.204.54@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788869870.664161:0:23784:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788869870.664197:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:0:x1875765305175168:12345-192.168.204.54@tcp:41:mount.lustre.0 Request processed in 70us (7273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869870.664210:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00080000:0.0:1788869870.664237:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869870.673800:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869870.674123:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305175424 00000100:00100000:0.0:1788869870.674139:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305175424 00000100:00100000:0.0:1788869870.674268:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1788869870.674281:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:18243:x1875765305175424:12345-192.168.204.54@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788869870.674404:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:18243:x1875765305175424:12345-192.168.204.54@tcp:40:mount.lustre.0 Request processed in 126us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869870.674412:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:0.0:1788869870.680928:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869870.680988:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869870.681031:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869870.681070:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869870.681089:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869870.681152:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869870.681184:0:24507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305176448 00000100:00100000:0.0:1788869870.681198:0:24507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305176448 00000100:00100000:0.0:1788869870.681254:0:24507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305176320 00000100:00100000:0.0:1788869870.681256:0:24507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305176320 00000100:00100000:0.0:1788869870.681273:0:24507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1788869870.681284:0:24507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96d468b1-a138-4403-9587-850a7665da93+5:2409:x1875765305176448:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869870.681620:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305175808 00000100:00100000:1.0:1788869870.681626:0:22676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305175808 00000100:00100000:1.0:1788869870.681665:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:1.0:1788869870.681673:0:22676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:18243:x1875765305175808:12345-192.168.204.54@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788869870.681757:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305176192 00000100:00100000:3.0:1788869870.681763:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305176192 00000100:00100000:3.0:1788869870.681796:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305176064 00000100:00100000:3.0:1788869870.681799:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305176064 00000100:00100000:3.0:1788869870.681820:0:24506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:3.0:1788869870.681828:0:24506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+6:2409:x1875765305176192:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869870.681936:0:24507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96d468b1-a138-4403-9587-850a7665da93+5:2409:x1875765305176448:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 650us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869870.681945:0:24507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1788869870.681968:0:24507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1788869870.681975:0:24507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841a36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96d468b1-a138-4403-9587-850a7665da93+6:2409:x1875765305176320:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869870.682064:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305175936 00000100:00100000:2.0:1788869870.682069:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305175936 00000100:00100000:2.0:1788869870.682106:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 146 00000100:00100000:2.0:1788869870.682113:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:2409:x1875765305175936:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869870.688948:0:22676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:18243:x1875765305175808:12345-192.168.204.54@tcp:900:mount.lustre.0 Request processed in 7251us (8025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869870.688970:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:1.0:1788869870.689268:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:1.0:1788869870.689762:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96d468b1-a138-4403-9587-850a7665da93+7:2409:x1875765305176064:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869870.689892:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96d468b1-a138-4403-9587-850a7665da93+7:2409:x1875765305176064:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 611us (8799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869870.689912:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:3.0:1788869870.690444:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869870.690479:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305175552 00000100:00100000:3.0:1788869870.690496:0:24176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305175552 00000100:00100000:3.0:1788869870.690544:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:3.0:1788869870.690551:0:24176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1875765305175552:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788869870.690632:0:24176:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e29a08ad-0316-4442-93c9-d46ea76b83fc@192.168.204.54@tcp t0 exp 0000000000000000 cur 804 last 0 00000020:00000080:3.0:1788869870.690677:0:24176:0:(genops.c:1384:class_connect()) connect: client e29a08ad-0316-4442-93c9-d46ea76b83fc, cookie 0x4c16c38a9b6d085c 00002000:00100000:3.0:1788869870.690692:0:24176:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e29a08ad-0316-4442-93c9-d46ea76b83fc/ffff8e282fe77800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788869870.690706:0:24176:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788869870.690804:0:24176:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788869870.690844:0:24176:0:(import.c:65:import_set_state_nolock()) ffff8e282fe73800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869870.690899:0:24176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:2406:x1875765305175552:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 348us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869870.690920:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:3.0:1788869870.690968:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869870.690990:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305175680 00000100:00100000:3.0:1788869870.690995:0:24174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305175680 00000100:00100000:3.0:1788869870.691013:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:3.0:1788869870.691018:0:24174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2406:x1875765305175680:12345-192.168.204.54@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788869870.691037:0:24174:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e29a08ad-0316-4442-93c9-d46ea76b83fc@192.168.204.54@tcp t0 exp 0000000000000000 cur 804 last 0 00000020:00000080:3.0:1788869870.691057:0:24174:0:(genops.c:1384:class_connect()) connect: client e29a08ad-0316-4442-93c9-d46ea76b83fc, cookie 0x4c16c38a9b6d0863 00002000:00100000:3.0:1788869870.691062:0:24174:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e29a08ad-0316-4442-93c9-d46ea76b83fc/ffff8e282fe76800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788869870.691069:0:24174:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788869870.691123:0:24174:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788869870.691140:0:24174:0:(import.c:65:import_set_state_nolock()) ffff8e282fe72000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788869870.691165:0:24174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:2406:x1875765305175680:12345-192.168.204.54@tcp:8:mount.lustre.0 Request processed in 145us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869870.691172:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:1.0:1788869870.691744:0:24506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+6:2409:x1875765305176192:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 9911us (10705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869870.691757:0:24506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:0.0:1788869870.691926:0:24507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841a36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96d468b1-a138-4403-9587-850a7665da93+6:2409:x1875765305176320:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 9949us (10771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869870.691935:0:24507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:2.0:1788869870.692494:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:2409:x1875765305175936:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 10369us (11493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869870.692658:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 146 00000100:00100000:2.0:1788869870.703798:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869870.706980:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305176576 00000100:00100000:1.0:1788869870.707119:0:22668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305176576 00000100:00100000:1.0:1788869870.707204:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:1.0:1788869870.707216:0:22668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:18243:x1875765305176576:12345-192.168.204.54@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788869870.707414:0:22668:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788869870.711139:0:22668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:18243:x1875765305176576:12345-192.168.204.54@tcp:33:mount.lustre.0 Request processed in 3905us (7336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869870.711161:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:2.0:1788869870.976753:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869870.976948:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305176704 00000100:00100000:0.0:1788869870.976964:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305176704 00000100:00100000:0.0:1788869870.977097:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:0.0:1788869870.977112:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:18278:x1875765305176704:12345-192.168.204.54@tcp:101:mkdir.0 00010000:00010000:0.0:1788869870.977148:0:23784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869870.977186:0:23784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031000/0x4c16c38a9b6d086a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca42c expref: -99 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869870.977276:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0871 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869870.977294:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0871 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869870.977329:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0871 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869870.977412:0:23784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788869870.977417:0:23784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869870.977447:0:23784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0871 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869870.977829:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031000/0x4c16c38a9b6d086a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca42c expref: 8 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869870.977859:0:23784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0871 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca42c expref: 7 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869870.977868:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ef8900) 00010000:00010000:0.0:1788869870.977871:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869870.977876:0:23784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2800030000, rc 0) 00000100:00100000:2.0:1788869870.978369:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e29a08ad-0316-4442-93c9-d46ea76b83fc+7:18278:x1875765305176704:12345-192.168.204.54@tcp:101:mkdir.0 Request processed in 1255us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869870.978400:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:3.0:1788869871.433326:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841a36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325224320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869871.433458:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869871.433628:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325224320 00000100:00100000:1.0:1788869871.433640:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325224320 00000100:00100000:1.0:1788869871.433730:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788869871.433743:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325224320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869871.433782:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788869871.433842:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325224320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869871.433849:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788869871.434175:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841a36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325224320:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788869871.434269:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788869871.560516:0:25255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869872.455146:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869872.455172:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325224448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869872.455260:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869872.455536:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325224448 00000100:00100000:2.0:1788869872.455546:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325224448 00000100:00100000:2.0:1788869872.455644:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788869872.455655:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325224448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788869872.455682:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788869872.455734:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325224448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869872.455742:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788869872.455789:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325224448:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788869872.455906:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788869872.587413:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869872.966189:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869872.966218:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27038eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325224576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869872.966300:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869872.966373:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325224576 00000100:00100000:2.0:1788869872.966382:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325224576 00000100:00100000:2.0:1788869872.966677:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788869872.966688:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325224576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788869872.966720:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788869872.966769:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325224576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869872.966777:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788869872.966797:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869872.966835:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27038eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325224576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788869872.972719:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e280138fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3649:1875765325224832:0@lo:400:kworker.0 00000100:00100000:3.0:1788869872.972810:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869872.972848:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325225344:0@lo:400:kworker.0 00000100:00100000:3.0:1788869872.972888:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869872.972906:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765325225856:0@lo:400:kworker.0 00000100:00100000:3.0:1788869872.972926:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869872.973029:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788869872.973037:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325224704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788869872.973065:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869872.973082:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325225216:0@lo:400:kworker.0 00000100:00100000:3.0:1788869872.973102:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869872.973121:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325225728:0@lo:400:kworker.0 00000100:00100000:3.0:1788869872.973142:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869872.973169:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325225216 00000100:00100000:3.0:1788869872.973177:0:24175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325225216 00000100:00100000:3.0:1788869872.973228:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788869872.973237:0:24175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325225216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869872.973286:0:24175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325225216:12345-0@lo:400:kworker.0 Request processed in 50us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869872.973294:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788869872.973323:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325225088:0@lo:400:kworker.0 00000100:00100000:3.0:1788869872.973347:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869872.973382:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765325225600:0@lo:400:kworker.0 00000100:00100000:3.0:1788869872.973405:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869872.973420:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325226112:0@lo:400:kworker.0 00000100:00100000:3.0:1788869872.973440:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869872.973457:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788869872.973463:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325224960:0@lo:400:kworker.0 00000100:00100000:3.0:1788869872.973485:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869872.973502:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325225472:0@lo:400:kworker.0 00000100:00100000:3.0:1788869872.973522:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869872.973536:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765325225984:0@lo:400:kworker.0 00000100:00100000:3.0:1788869872.973559:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869872.973579:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325225088 00000100:00100000:3.0:1788869872.973583:0:24176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325225088 00000100:00100000:3.0:1788869872.973630:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869872.973637:0:24176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325225088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869872.973671:0:24176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325225088:12345-0@lo:400:kworker.0 Request processed in 34us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869872.973677:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788869872.973695:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325224960 00000100:00100000:3.0:1788869872.973699:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325224960 00000100:00100000:3.0:1788869872.973719:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325225472 00000100:00100000:3.0:1788869872.973722:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325225472 00000100:00100000:3.0:1788869872.973735:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788869872.973740:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325224960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869872.973772:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325224960:12345-0@lo:400:kworker.0 Request processed in 31us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869872.973777:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788869872.973797:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788869872.973803:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325225472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869872.973833:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325225472:12345-0@lo:400:kworker.0 Request processed in 30us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869872.973839:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788869872.974110:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325225344 00000100:00100000:1.0:1788869872.974116:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325225344 00000100:00100000:1.0:1788869872.974139:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325225856 00000100:00100000:1.0:1788869872.974142:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325225856 00000100:00100000:1.0:1788869872.974157:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325225728 00000100:00100000:1.0:1788869872.974160:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325225728 00000100:00100000:1.0:1788869872.974173:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325225600 00000100:00100000:1.0:1788869872.974175:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325225600 00000100:00100000:1.0:1788869872.974186:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325226112 00000100:00100000:1.0:1788869872.974188:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325226112 00000100:00100000:1.0:1788869872.974201:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325225984 00000100:00100000:1.0:1788869872.974202:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325225984 00000100:00100000:1.0:1788869872.974217:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788869872.974224:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325225344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869872.974262:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325225344:12345-0@lo:400:kworker.0 Request processed in 39us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869872.974268:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788869872.974280:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788869872.974286:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875765325225856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869872.974311:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875765325225856:12345-0@lo:400:kworker.0 Request processed in 25us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869872.974316:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788869872.974326:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788869872.974332:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325225728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869872.974357:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875765325225728:12345-0@lo:400:kworker.0 Request processed in 26us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869872.974373:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788869872.974385:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788869872.974391:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765325225600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869872.974418:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765325225600:12345-0@lo:400:kworker.0 Request processed in 28us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869872.974423:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788869872.974433:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788869872.974439:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325226112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869872.974463:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325226112:12345-0@lo:400:kworker.0 Request processed in 25us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869872.974469:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788869872.974478:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788869872.974483:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765325225984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869872.974505:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765325225984:12345-0@lo:400:kworker.0 Request processed in 22us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869872.974511:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788869872.974916:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1788869872.975112:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325225216:0@lo:400:kworker.0 00000100:00100000:1.0:1788869872.975197:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875765325225728:0@lo:400:kworker.0 00000100:00100000:1.0:1788869872.975209:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325225344:0@lo:400:kworker.0 00010000:00080000:1.0:1788869872.975239:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040ab800 x1875765325225856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869872.975249:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765325225856:0@lo:400:kworker.0 00000100:00100000:2.0:1788869872.975653:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325224832 00000100:00100000:2.0:1788869872.975664:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325224832 00000100:00100000:2.0:1788869872.975700:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788869872.975709:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:3649:x1875765325224832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869872.975798:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:3649:x1875765325224832:12345-0@lo:400:kworker.0 Request processed in 90us (2988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869872.975806:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1788869872.975892:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869872.975897:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869872.975900:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869872.975985:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325224704 00000100:00100000:2.0:1788869872.975990:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325224704 00000100:00100000:2.0:1788869872.976016:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788869872.976023:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325224704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788869872.976040:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788869872.976073:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325224704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (3007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869872.976080:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788869872.976121:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325224704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869872.976132:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e280138fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3649:1875765325224832:0@lo:400:kworker.0 00000100:00100000:3.0:1788869872.977381:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325224960:0@lo:400:kworker.0 00000100:00100000:3.0:1788869872.977407:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325225472:0@lo:400:kworker.0 00000100:00100000:3.0:1788869872.977422:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765325225984:0@lo:400:kworker.0 00000100:00100000:3.0:1788869872.977434:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325225088:0@lo:400:kworker.0 00000100:00100000:3.0:1788869872.977445:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765325225600:0@lo:400:kworker.0 00010000:00080000:3.0:1788869872.977458:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27040a8a80 x1875765325226112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788869872.977467:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325226112:0@lo:400:kworker.0 00000001:00100000:1.0:1788869872.978724:0:24170:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e29a08ad-0316-4442-93c9-d46ea76b83fc 00000001:00100000:1.0:1788869872.978738:0:24170:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 96d468b1-a138-4403-9587-850a7665da93 00000001:00100000:2.0:1788869872.978871:0:22644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e29a08ad-0316-4442-93c9-d46ea76b83fc 00000001:00100000:2.0:1788869872.978878:0:22644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 96d468b1-a138-4403-9587-850a7665da93 00000001:00100000:2.0:1788869872.979482:0:23398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e29a08ad-0316-4442-93c9-d46ea76b83fc 00000001:00100000:2.0:1788869872.979491:0:23398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 96d468b1-a138-4403-9587-850a7665da93 00000100:00100000:1.0:1788869873.477959:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788869873.477990:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325226240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869873.478097:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869873.479380:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325226240 00000100:00100000:3.0:1788869873.479394:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325226240 00000100:00100000:3.0:1788869873.479476:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788869873.479489:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325226240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788869873.479529:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788869873.479624:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325226240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869873.479632:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788869873.482065:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788869873.482109:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325226368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869873.482213:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869873.482295:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325226368 00000100:00100000:2.0:1788869873.482308:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325226368 00000100:00100000:0.0:1788869873.482340:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325226240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788869873.482380:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788869873.482410:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325226368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788869873.482450:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788869873.482510:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325226368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869873.482518:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788869873.483340:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325226368:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788869873.606010:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869874.310348:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788869874.631447:0:25255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788869875.020490:0:25548:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788869875.656029:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788869876.043413:0:24990:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e29a08ad-0316-4442-93c9-d46ea76b83fc 00000100:00100000:0.0:1788869876.160012:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869876.160063:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869876.160118:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869876.160144:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869876.160443:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305176832 00000100:00100000:2.0:1788869876.160457:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305176832 00000100:00100000:2.0:1788869876.160517:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 148 00000100:00100000:2.0:1788869876.160528:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:2410:x1875765305176832:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869876.160632:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:2410:x1875765305176832:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 105us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869876.160639:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 148 00000100:00100000:2.0:1788869876.160810:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305177088 00000100:00100000:2.0:1788869876.160815:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305177088 00000100:00100000:2.0:1788869876.160856:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305177600 00000100:00100000:2.0:1788869876.160858:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305177600 00000100:00100000:2.0:1788869876.160875:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:2.0:1788869876.160881:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+5:2410:x1875765305177088:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869876.160929:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+5:2410:x1875765305177088:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 47us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869876.160936:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:2.0:1788869876.160948:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:2.0:1788869876.160954:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:2410:x1875765305177600:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869876.160989:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:2410:x1875765305177600:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 35us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869876.160995:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00080000:2.0:1788869876.161012:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869876.161509:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305177344 00000100:00100000:3.0:1788869876.161515:0:24175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305177344 00000100:00100000:3.0:1788869876.161578:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1788869876.161622:0:24175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841a34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96d468b1-a138-4403-9587-850a7665da93+5:2410:x1875765305177344:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869876.161672:0:24175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841a34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96d468b1-a138-4403-9587-850a7665da93+5:2410:x1875765305177344:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 53us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869876.161679:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00080000:2.0:1788869876.162185:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869876.162472:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869876.162545:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869876.162579:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869876.162689:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305177856 00000100:00100000:1.0:1788869876.162689:0:24507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305177216 00000100:00100000:1.0:1788869876.162707:0:24507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305177216 00000100:00100000:3.0:1788869876.162708:0:24176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305177856 00000100:00100000:2.0:1788869876.162776:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305176960 00000100:00100000:2.0:1788869876.162794:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305176960 00000100:00100000:1.0:1788869876.162858:0:24507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1788869876.162867:0:24507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841a35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96d468b1-a138-4403-9587-850a7665da93+5:2410:x1875765305177216:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869876.162930:0:24507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841a35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96d468b1-a138-4403-9587-850a7665da93+5:2410:x1875765305177216:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 64us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869876.162937:0:24507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00080000:1.0:1788869876.167614:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869876.167627:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788869876.167631:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788869876.167793:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869876.168160:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:3.0:1788869876.168180:0:24176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:2410:x1875765305177856:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869876.168284:0:24176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:2410:x1875765305177856:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 110us (5813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869876.168292:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:3.0:1788869876.168508:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305177472 00000100:00100000:3.0:1788869876.168521:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305177472 00000100:00100000:3.0:1788869876.168576:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:3.0:1788869876.168583:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:2410:x1875765305177472:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869876.168878:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:2410:x1875765305177472:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 294us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869876.168886:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00080000:3.0:1788869876.168909:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869876.169837:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:2.0:1788869876.169864:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+6:2410:x1875765305176960:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869876.169972:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+6:2410:x1875765305176960:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 124us (7427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869876.169981:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:0.0:1788869876.174979:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869876.178862:0:24507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305177728 00000100:00100000:2.0:1788869876.178883:0:24507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305177728 00000100:00100000:2.0:1788869876.179135:0:24507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:2.0:1788869876.179149:0:24507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841a34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:2410:x1875765305177728:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869876.181059:0:24507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841a34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:2410:x1875765305177728:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 1901us (6146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869876.181075:0:24507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00080000:3.0:1788869876.182021:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869876.552537:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869876.552566:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325226496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788869876.552703:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869876.552781:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325226496 00000100:00100000:2.0:1788869876.552791:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325226496 00000100:00100000:2.0:1788869876.552878:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788869876.552888:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325226496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788869876.552920:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788869876.552971:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325226496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869876.552995:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788869876.553001:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325226496:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788869876.554004:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788869876.678069:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788869877.255520:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788869877.577678:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841a36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325226624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788869877.577788:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869877.577880:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325226624 00000100:00100000:0.0:1788869877.577891:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325226624 00000100:00100000:0.0:1788869877.578200:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788869877.578212:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841a37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325226624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869877.578550:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788869877.579110:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841a37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325226624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 897us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869877.579121:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788869877.579196:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841a36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325226624:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788869877.584364:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788869877.702847:0:25255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869878.086916:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325226752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869878.087000:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869878.087081:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325226752 00000100:00100000:2.0:1788869878.087091:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325226752 00000100:00100000:2.0:1788869878.087148:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788869878.087157:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325226752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788869878.087190:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788869878.087237:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325226752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869878.087245:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788869878.087267:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869878.087309:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325226752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869878.087776:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869878.087788:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325226880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869878.087828:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869878.087999:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325226880 00000100:00100000:1.0:1788869878.088006:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325226880 00000100:00100000:1.0:1788869878.088051:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788869878.088058:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325226880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869878.088073:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788869878.088113:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325226880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869878.088133:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788869878.088178:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869878.088255:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325226880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788869878.093381:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325227008:0@lo:400:kworker.0 00000100:00100000:0.0:1788869878.093459:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869878.093576:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869878.093582:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325227136:0@lo:400:kworker.0 00000100:00100000:0.0:1788869878.093643:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869878.093679:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325227008 00000100:00100000:0.0:1788869878.093701:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325227008 00000100:00100000:0.0:1788869878.093765:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788869878.093776:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:3650:x1875765325227008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869878.093831:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:3650:x1875765325227008:12345-0@lo:400:kworker.0 Request processed in 56us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869878.093839:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788869878.093892:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325227008:0@lo:400:kworker.0 00000100:00100000:3.0:1788869878.097435:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325227136 00000100:00100000:3.0:1788869878.097457:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325227136 00000100:00100000:3.0:1788869878.097535:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788869878.097546:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325227136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869878.097713:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325227136:12345-0@lo:400:kworker.0 Request processed in 168us (4069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869878.097721:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788869878.097790:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325227136:0@lo:400:kworker.0 00000100:00100000:2.0:1788869878.098188:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869878.098202:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325227520:0@lo:400:kworker.0 00000100:00100000:2.0:1788869878.098249:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869878.098293:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325227520 00000100:00100000:2.0:1788869878.098298:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325227520 00000100:00100000:2.0:1788869878.098330:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788869878.098336:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325227520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869878.098387:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325227520:12345-0@lo:400:kworker.0 Request processed in 50us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869878.098393:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788869878.098421:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325227520:0@lo:400:kworker.0 00000100:00100000:2.0:1788869878.098454:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325227648:0@lo:400:kworker.0 00000100:00100000:2.0:1788869878.098482:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869878.098529:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788869878.098535:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325228032:0@lo:400:kworker.0 00000100:00100000:2.0:1788869878.098563:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869878.098694:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325227392:0@lo:400:kworker.0 00000100:00100000:0.0:1788869878.098726:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869878.098762:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325227904:0@lo:400:kworker.0 00000100:00100000:0.0:1788869878.098785:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869878.098804:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788869878.098809:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325227264:0@lo:400:kworker.0 00000100:00100000:0.0:1788869878.098835:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869878.098853:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325227776:0@lo:400:kworker.0 00000100:00100000:0.0:1788869878.098872:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869878.098898:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325228032 00000100:00100000:0.0:1788869878.098903:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325228032 00000100:00100000:0.0:1788869878.098944:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325227392 00000100:00100000:0.0:1788869878.098948:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325227392 00000100:00100000:0.0:1788869878.098965:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325227904 00000100:00100000:0.0:1788869878.098968:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325227904 00000100:00100000:0.0:1788869878.098982:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788869878.098988:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325228032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869878.099143:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788869878.099151:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841a37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325227392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869878.099190:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841a37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875765325227392:12345-0@lo:400:kworker.0 Request processed in 40us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869878.099196:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788869878.099213:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788869878.099220:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325227904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869878.099245:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875765325227904:12345-0@lo:400:kworker.0 Request processed in 27us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869878.099250:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788869878.099343:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325227648 00000100:00100000:3.0:1788869878.099348:0:24174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325227648 00000100:00100000:3.0:1788869878.099378:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325227264 00000100:00100000:3.0:1788869878.099382:0:24174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325227264 00000100:00100000:3.0:1788869878.099396:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325227776 00000100:00100000:3.0:1788869878.099398:0:24174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325227776 00000100:00100000:3.0:1788869878.099413:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788869878.099419:0:24174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325227648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869878.102529:0:24507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788869878.102563:0:24507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282e629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325227264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869878.102705:0:24507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282e629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325227264:12345-0@lo:400:kworker.0 Request processed in 160us (3868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869878.102714:0:24507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788869878.102757:0:24507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788869878.102767:0:24507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325227776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869878.102802:0:24507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325227776:12345-0@lo:400:kworker.0 Request processed in 37us (3928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869878.102807:0:24507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788869878.102837:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869878.102844:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869878.103299:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325228032:12345-0@lo:400:kworker.0 Request processed in 4308us (4732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869878.103328:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788869878.103403:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325227264:0@lo:400:kworker.0 00000100:00100000:0.0:1788869878.103417:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325227776:0@lo:400:kworker.0 00000100:00100000:0.0:1788869878.103429:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875765325227392:0@lo:400:kworker.0 00000100:00100000:0.0:1788869878.103440:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875765325227904:0@lo:400:kworker.0 00000100:00100000:1.0:1788869878.103547:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325228160:0@lo:400:kworker.0 00000100:00100000:1.0:1788869878.103635:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869878.103705:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325228160 00000100:00100000:0.0:1788869878.103713:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325228160 00000100:00100000:0.0:1788869878.103900:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788869878.103910:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325228160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869878.104353:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325228288:0@lo:400:kworker.0 00000100:00100000:2.0:1788869878.104391:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869878.104432:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325228288 00000100:00100000:2.0:1788869878.104437:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325228288 00000100:00100000:2.0:1788869878.104478:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788869878.104486:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325228288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869878.104537:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875765325228288:12345-0@lo:400:kworker.0 Request processed in 52us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869878.104545:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788869878.104582:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875765325228288:0@lo:400:kworker.0 00000100:00100000:2.0:1788869878.104651:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875765325228416:0@lo:400:kworker.0 00000100:00100000:2.0:1788869878.104682:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869878.104713:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325228416 00000100:00100000:2.0:1788869878.104716:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325228416 00000100:00100000:2.0:1788869878.104756:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788869878.104763:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875765325228416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869878.104800:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875765325228416:12345-0@lo:400:kworker.0 Request processed in 38us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869878.104807:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1788869878.104837:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a8d500 x1875765325228416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869878.104848:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875765325228416:0@lo:400:kworker.0 00000100:00100000:3.0:1788869878.106510:0:24174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325227648:12345-0@lo:400:kworker.0 Request processed in 7082us (8018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869878.106525:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788869878.114971:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325228032:0@lo:400:kworker.0 00000100:00100000:1.0:1788869878.115010:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325227648:0@lo:400:kworker.0 00000100:00100000:0.0:1788869878.121465:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325228160:12345-0@lo:400:kworker.0 Request processed in 17545us (17816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869878.121483:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1788869878.121545:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869878.121553:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788869878.122459:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2703a8c700 x1875765325228160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869878.122481:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325228160:0@lo:400:kworker.0 00000100:00100000:1.0:1788869878.602401:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325228672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869878.602487:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869878.602531:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869878.602559:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325228544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869878.602609:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869878.602644:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325228672 00000100:00100000:1.0:1788869878.602652:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325228672 00000100:00100000:1.0:1788869878.602693:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325228544 00000100:00100000:1.0:1788869878.602695:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325228544 00000100:00100000:1.0:1788869878.602711:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788869878.602718:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325228672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869878.602769:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788869878.602816:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325228672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869878.602823:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788869878.602841:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788869878.602846:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325228544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788869878.602862:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788869878.602888:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325228544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 42us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869878.602894:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788869878.602940:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325228544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869878.602952:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325228672:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788869878.725949:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788869879.751846:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788869880.377394:0:25696:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1468fbc0 20000000:00000080:0.0:1788869880.377422:0:25696:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e2841a48400 uarg=0000000000000000 20000000:01000000:0.0:1788869880.377474:0:25696:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788869880.377480:0:25696:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788869880.377485:0:25696:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788869880.381245:0:25697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788869880.381654:0:25696:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788869880.396863:0:25696:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788869880.396910:0:25696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e2800031a00/0x4c16c38a9b6d0878 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869880.396934:0:25696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840ed8800/0x4c16c38a9b6d04d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d04ce expref: 23 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869880.396960:0:25696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d04e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d04dc expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869880.396967:0:25696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6d0522 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d051b expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869880.396974:0:25696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840eda200/0x4c16c38a9b6d069c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d0695 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869880.396983:0:25696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6d0808 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca38b expref: 12 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869880.396991:0:25696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6d0847 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca3fb expref: 12 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869880.396998:0:25696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e2800031a00/0x4c16c38a9b6d0878 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869880.397053:0:25696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6d0847 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca3fb expref: 12 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869880.397082:0:25696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6d0847 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca3fb expref: 12 pid: 22658 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869880.397108:0:25696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841a36d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1875765325228800:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869880.397240:0:25696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6d0808 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca38b expref: 12 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869880.397248:0:25696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6d0808 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca38b expref: 12 pid: 22658 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869880.397264:0:25696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841a36300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1875765325228928:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869880.397297:0:25696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840eda200/0x4c16c38a9b6d069c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6d0695 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869880.397305:0:25696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840eda200/0x4c16c38a9b6d069c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6d0695 expref: 23 pid: 22659 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869880.397315:0:25696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841a34700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1875765325229056:0@lo:104: 00000100:00100000:0.0:1788869880.397361:0:25696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869880.397402:0:25696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6d0522 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6d051b expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869880.397411:0:25696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6d0522 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6d051b expref: 23 pid: 22659 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869880.397420:0:25696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841a37b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1875765325229184:0@lo:104: 00000100:00100000:0.0:1788869880.397442:0:25696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788869880.397470:0:25696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d04e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6d04dc expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869880.397478:0:25696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d04e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6d04dc expref: 23 pid: 22659 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869880.397486:0:25696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841a37480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1875765325229312:0@lo:104: 00000100:00100000:0.0:1788869880.397505:0:25696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869880.397530:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325229056 00000100:00100000:2.0:1788869880.397540:0:22648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325229056 00010000:00010000:0.0:1788869880.397545:0:25696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e2840ed8800/0x4c16c38a9b6d04d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4c16c38a9b6d04ce expref: 23 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869880.397568:0:25696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e2840ed8800/0x4c16c38a9b6d04d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4c16c38a9b6d04ce expref: 23 pid: 22658 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869880.397578:0:25696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702929880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1875765325229440:0@lo:104: 00000100:00100000:2.0:1788869880.397618:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325229184 00000100:00100000:2.0:1788869880.397623:0:22648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325229184 00000100:00100000:0.0:1788869880.397634:0:25696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869880.397642:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325229312 00000100:00100000:2.0:1788869880.397647:0:22648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325229312 00000100:00100000:0.0:1788869880.397657:0:25696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802aac840 going to sleep for 11 seconds 00000100:00100000:2.0:1788869880.397662:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325229440 00000100:00100000:2.0:1788869880.397666:0:22648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325229440 00000100:00100000:2.0:1788869880.397697:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788869880.397708:0:22648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841a35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+6:25696:x1875765325229056:12345-0@lo:104: 00010000:00010000:2.0:1788869880.397733:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840edbc00/0x4c16c38a9b6d0695 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d069c expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.397820:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788869880.397828:0:22648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841a35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+6:25696:x1875765325229056:12345-0@lo:104: Request processed in 122us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869880.397836:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788869880.397860:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788869880.397866:0:22648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841a34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+5:25696:x1875765325229184:12345-0@lo:104: 00010000:00010000:2.0:1788869880.397874:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2842043e00/0x4c16c38a9b6d051b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d0522 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.397919:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788869880.397925:0:22648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841a34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+5:25696:x1875765325229184:12345-0@lo:104: Request processed in 60us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869880.397931:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788869880.397944:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788869880.397950:0:22648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841a36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+4:25696:x1875765325229312:12345-0@lo:104: 00010000:00010000:2.0:1788869880.397958:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d04dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d04e3 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.397990:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788869880.397996:0:22648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841a36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+4:25696:x1875765325229312:12345-0@lo:104: Request processed in 46us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869880.398001:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788869880.398014:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788869880.398019:0:22648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702928700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+3:25696:x1875765325229440:12345-0@lo:104: 00010000:00010000:2.0:1788869880.398033:0:22648:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d04ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d04d5 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.398058:0:22648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788869880.398063:0:22648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702928700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+3:25696:x1875765325229440:12345-0@lo:104: Request processed in 44us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869880.398068:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788869880.398086:0:25255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788869880.398093:0:25255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840edbc00/0x4c16c38a9b6d0695 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d069c expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.398101:0:25255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edbc00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869880.398118:0:25255:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edbc00/0x4c16c38a9b6d0695 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6d069c expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.398128:0:25255:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840edbc00/0x4c16c38a9b6d0695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6d069c expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869880.398136:0:25255:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edbc00/0x4c16c38a9b6d0695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6d069c expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869880.398142:0:25255:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788869880.398172:0:25255:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840edbc00/0x4c16c38a9b6d0695 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d069c expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.398179:0:25255:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869880.398200:0:25255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840edbc00/0x4c16c38a9b6d0695 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d069c expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.398207:0:25255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840edbc00/0x4c16c38a9b6d0695 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d069c expref: -99 pid: 24989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.398227:0:25255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788869880.398230:0:25255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2842043e00/0x4c16c38a9b6d051b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d0522 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.398236:0:25255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842043e00 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869880.398240:0:25255:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2842043e00/0x4c16c38a9b6d051b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6d0522 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.398245:0:22652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788869880.398247:0:25255:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2842043e00/0x4c16c38a9b6d051b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6d0522 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.398254:0:22652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d04dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d04e3 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869880.398256:0:25255:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2842043e00/0x4c16c38a9b6d051b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6d0522 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788869880.398267:0:25255:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788869880.398280:0:22652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edb000 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:1.0:1788869880.398283:0:22652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d04dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6d04e3 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.398290:0:25255:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2842043e00/0x4c16c38a9b6d051b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d0522 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.398307:0:25255:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788869880.398311:0:22652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d04dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6d04e3 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.398318:0:25255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2842043e00/0x4c16c38a9b6d051b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d0522 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788869880.398319:0:22652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d04dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6d04e3 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869880.398336:0:22652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788869880.398337:0:25255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2842043e00/0x4c16c38a9b6d051b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d0522 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.398352:0:25255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869880.398356:0:25255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d04ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4c16c38a9b6d04d5 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.398357:0:22652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d04dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d04e3 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.398372:0:22652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869880.398384:0:25255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842043400 already unused, calling callback (ffffffffc1332c20) 10000000:00010000:2.0:1788869880.398389:0:25255:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d04ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4c16c38a9b6d04d5 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.398394:0:22652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d04dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d04e3 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.398397:0:25255:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d04ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4c16c38a9b6d04d5 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.398408:0:22652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d04dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d04e3 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788869880.398413:0:25255:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d04ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4c16c38a9b6d04d5 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.398420:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788869880.398422:0:25255:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788869880.398423:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869880.398427:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788869880.398436:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869880.398444:0:25255:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d04ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d04d5 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869880.398452:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325229824:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869880.398453:0:25255:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788869880.398464:0:25255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d04ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d04d5 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.398472:0:25255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.154@tcp lock: ffff8e2842043400/0x4c16c38a9b6d04ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4c16c38a9b6d04d5 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.398492:0:25255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869880.398494:0:25255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869880.398497:0:25255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869880.398502:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869880.398515:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3648:1875765325229568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869880.398536:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788869880.398546:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325229952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869880.398554:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869880.398580:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869880.398610:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788869880.398619:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3648:1875765325229696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869880.398661:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325229824 00000100:00100000:2.0:1788869880.398667:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869880.398669:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325229824 00000100:00100000:2.0:1788869880.398708:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325229568 00000100:00100000:2.0:1788869880.398713:0:22649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325229568 00010000:00010000:1.0:1788869880.398723:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d04e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d04dc expref: 25 pid: 22659 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.398732:0:22649:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840eda200/0x4c16c38a9b6d069c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d0695 expref: 25 pid: 22659 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869880.398749:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325229952 00000100:00100000:2.0:1788869880.398751:0:22649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325229952 00010000:00010000:2.0:1788869880.398759:0:22649:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840ed8800/0x4c16c38a9b6d04d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d04ce expref: 26 pid: 22658 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869880.398767:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325229696 00000100:00100000:2.0:1788869880.398769:0:22649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325229696 00010000:00010000:2.0:1788869880.398780:0:22649:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6d0522 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d051b expref: 27 pid: 22659 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869880.398791:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788869880.398796:0:22649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+27:3650:x1875765325229824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869880.398808:0:22649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869880.398812:0:22649:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d04e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d04dc expref: 27 pid: 22659 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.398822:0:22649:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d04e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6d04dc expref: 27 pid: 22659 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.398839:0:22649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869880.398867:0:22649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+27:3650:x1875765325229824:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869880.398873:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788869880.398886:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788869880.398898:0:22649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+26:3648:x1875765325229568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788869880.398906:0:22649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869880.398910:0:22649:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840eda200/0x4c16c38a9b6d069c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d0695 expref: 26 pid: 22659 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.398918:0:22649:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840eda200/0x4c16c38a9b6d069c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6d0695 expref: 26 pid: 22659 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.398930:0:22649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869880.398935:0:22651:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788869880.398946:0:22651:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788869880.398959:0:22649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+26:3648:x1875765325229568:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869880.398966:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788869880.398968:0:22650:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788869880.398979:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788869880.398985:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788869880.398990:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+25:3650:x1875765325229952:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869880.398999:0:22649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+25:3648:x1875765325229696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869880.399002:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869880.399009:0:22649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869880.399010:0:22650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840ed8800/0x4c16c38a9b6d04d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d04ce expref: 25 pid: 22658 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.399016:0:22649:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6d0522 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4c16c38a9b6d051b expref: 25 pid: 22659 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.399027:0:22650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840ed8800/0x4c16c38a9b6d04d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6d04ce expref: 25 pid: 22658 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869880.399320:0:25696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840eda200/0x4c16c38a9b6d069c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6d0695 expref: 25 pid: 22659 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869880.399332:0:25696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841a34700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1875765325229056:0@lo:104: 00000100:00100000:0.0:1788869880.399343:0:25696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841a37b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1875765325229184:0@lo:104: 00010000:00010000:0.0:1788869880.399351:0:25696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840ed8200/0x4c16c38a9b6d04e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6d04dc expref: 24 pid: 22659 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869880.399358:0:25696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841a37480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1875765325229312:0@lo:104: 00000100:00100000:0.0:1788869880.399366:0:25696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702929880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1875765325229440:0@lo:104: 00010000:00010000:2.0:1788869880.399963:0:22649:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6d0522 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4c16c38a9b6d051b expref: 23 pid: 22659 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.399979:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840edac00/0x4c16c38a9b6d0522 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6d051b expref: 23 pid: 22659 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.399990:0:22649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869880.400037:0:22649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:3648:x1875765325229696:12345-0@lo:103:ldlm_bl.0 Request processed in 1042us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869880.400046:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788869880.400523:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325229824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869880.401222:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3648:1875765325229696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788869880.401259:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3648:1875765325229568:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788869880.401652:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840ed8800/0x4c16c38a9b6d04d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4c16c38a9b6d04ce expref: 21 pid: 22658 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.401669:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869880.401753:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+20:3650:x1875765325229952:12345-0@lo:103:ldlm_bl.0 Request processed in 2765us (3172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869880.401762:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788869880.401856:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3650:1875765325229952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788869880.405264:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869880.405359:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305177984 00000100:00100000:2.0:1788869880.405373:0:22649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305177984 00010000:00010000:2.0:1788869880.405423:0:22649:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6d0847 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca3fb expref: 13 pid: 22658 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869880.405469:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:2.0:1788869880.405479:0:22649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2825c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:2409:x1875765305177984:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869880.405497:0:22649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869880.405505:0:22649:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6d0847 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca3fb expref: 13 pid: 22658 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.405516:0:22649:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6d0847 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca3fb expref: 13 pid: 22658 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.405542:0:22649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869880.405659:0:22649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2825c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:2409:x1875765305177984:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 177us (404us total) trans 0 rc 0/0 00010000:00010000:0.0:1788869880.405659:0:25696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2840c7e800/0x4c16c38a9b6d0847 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca3fb expref: 13 pid: 22658 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869880.405674:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:0.0:1788869880.405695:0:25696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841a36d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1875765325228800:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869880.405712:0:25696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841a36300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25696:1875765325228928:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869880.405761:0:25696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e2800031a00/0x4c16c38a9b6d0878 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869880.420044:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869880.420231:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305178112 00000100:00100000:1.0:1788869880.420246:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305178112 00010000:00010000:1.0:1788869880.420292:0:22650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6d0808 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca38b expref: 12 pid: 22658 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869880.420344:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:1.0:1788869880.420356:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+12:2409:x1875765305178112:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869880.420397:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869880.420403:0:22650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6d0808 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca38b expref: 12 pid: 22658 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.420418:0:22650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6d0808 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca38b expref: 12 pid: 22658 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.420438:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6d0808 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca38b expref: 12 pid: 22658 timeout: 914 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.420459:0:22650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e2800031a00/0x4c16c38a9b6d0878 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.420467:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2800031a00/0x4c16c38a9b6d0878 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.420490:0:22650:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2800031a00/0x4c16c38a9b6d0878 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.420499:0:22650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e2800031a00/0x4c16c38a9b6d0878 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.420506:0:22650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e2800031a00/0x4c16c38a9b6d0878 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.420513:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e2800031a00/0x4c16c38a9b6d0878 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.420519:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800031a00 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:1.0:1788869880.420523:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e2800031a00/0x4c16c38a9b6d0878 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.420542:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e2800031a00/0x4c16c38a9b6d0878 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.420572:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e2800031a00/0x4c16c38a9b6d0878 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.420747:0:25696:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e2800031a00/0x4c16c38a9b6d0878 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.420759:0:25696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e2800031a00/0x4c16c38a9b6d0878 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869880.420765:0:25696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e2800031a00/0x4c16c38a9b6d0878 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869880.420866:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869880.423077:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+11:2409:x1875765305178112:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 2712us (3054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869880.423093:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00010000:00010000:1.0:1788869880.778413:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869881.279009:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869881.279064:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869881.279099:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869881.279128:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869881.279157:0:24507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305178624 00000100:00100000:1.0:1788869881.279160:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869881.279167:0:24507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305178624 00000100:00100000:1.0:1788869881.279194:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869881.279212:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869881.279226:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869881.279231:0:24507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305179136 00000100:00100000:3.0:1788869881.279234:0:24507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305179136 00000100:00100000:1.0:1788869881.279250:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869881.279264:0:24507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305178752 00000100:00100000:3.0:1788869881.279266:0:24507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305178752 00000100:00100000:1.0:1788869881.279266:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305179264 00000100:00100000:1.0:1788869881.279268:0:24175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305179264 00000100:00100000:3.0:1788869881.279284:0:24507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:3.0:1788869881.279293:0:24507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96d468b1-a138-4403-9587-850a7665da93+5:2410:x1875765305178624:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869881.279343:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305178368 00000100:00100000:2.0:1788869881.279347:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305178368 00000100:00100000:2.0:1788869881.279376:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305178880 00000100:00100000:2.0:1788869881.279378:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305178880 00000100:00100000:3.0:1788869881.279379:0:24507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96d468b1-a138-4403-9587-850a7665da93+5:2410:x1875765305178624:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 87us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869881.279390:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305178496 00000100:00100000:2.0:1788869881.279392:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305178496 00000100:00100000:0.0:1788869881.279439:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305179008 00000100:00100000:0.0:1788869881.279456:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305179008 00000100:00100000:0.0:1788869881.279480:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:0.0:1788869881.279487:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96d468b1-a138-4403-9587-850a7665da93+6:2410:x1875765305178368:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869881.279518:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96d468b1-a138-4403-9587-850a7665da93+6:2410:x1875765305178368:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 32us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869881.279525:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:0.0:1788869881.279544:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:0.0:1788869881.279551:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:2410:x1875765305178880:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869881.279575:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:2410:x1875765305178880:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869881.279581:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:0.0:1788869881.279650:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:0.0:1788869881.279657:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:2410:x1875765305179008:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869881.279697:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:2410:x1875765305179008:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 40us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869881.279703:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00080000:0.0:1788869881.279724:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788869881.279729:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869881.279732:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788869881.279734:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869881.279787:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:1.0:1788869881.279797:0:24175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:2410:x1875765305179136:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869881.279825:0:24175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:2410:x1875765305179136:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 30us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869881.279832:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:1.0:1788869881.279844:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:1.0:1788869881.279850:0:24175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96d468b1-a138-4403-9587-850a7665da93+5:2410:x1875765305178752:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869881.279884:0:24175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96d468b1-a138-4403-9587-850a7665da93+5:2410:x1875765305178752:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 34us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869881.279891:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:1.0:1788869881.279904:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:1.0:1788869881.279910:0:24175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:2410:x1875765305179264:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869881.279934:0:24175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:2410:x1875765305179264:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869881.279940:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:1.0:1788869881.279960:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305178240 00000100:00100000:1.0:1788869881.279964:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305178240 00000100:00100000:1.0:1788869881.279993:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 150 00000100:00100000:1.0:1788869881.280000:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+11:2410:x1875765305178240:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869881.280026:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+11:2410:x1875765305178240:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869881.280032:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 150 00000100:00100000:2.0:1788869881.280421:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:2.0:1788869881.280428:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+5:2410:x1875765305178496:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:2.0:1788869881.280453:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+5:2410:x1875765305178496:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 26us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869881.280459:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00080000:1.0:1788869881.283192:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788869881.290833:0:24507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 10000000:01000000:1.0:1788869881.544644:0:22661:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788869881.544654:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e282617b000 from 13 10000000:01000000:1.0:1788869881.544658:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869881.544912:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d087f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869881.544924:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d087f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869881.544938:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d087f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869881.544994:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325230080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869881.545072:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869881.545275:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325230080 00000100:00100000:1.0:1788869881.545684:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e46240 going to sleep for 11 seconds 00000100:00100000:2.0:1788869881.545972:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325230080 00000100:00100000:2.0:1788869881.546056:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788869881.546067:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+20:22661:x1875765325230080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869881.546085:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869881.546104:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6d0886 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d087f expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869881.546232:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6d0886 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d087f expref: 21 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869881.546244:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28029d6e00/0x4c16c38a9b6d0886 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d087f expref: 21 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869881.546273:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6e00, rc 0) 00000100:00100000:2.0:1788869881.546580:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:22661:x1875765325230080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 514us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869881.546607:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788869881.546891:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325230080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869881.546909:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d087f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0886 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869881.546918:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d087f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d0886 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869881.546991:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325230208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869881.547025:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869881.547065:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e46240 going to sleep for 11 seconds 00000100:00100000:0.0:1788869881.547309:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325230208 00000100:00100000:0.0:1788869881.547318:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325230208 00000100:00100000:0.0:1788869881.547410:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788869881.547419:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:22661:x1875765325230208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869881.547556:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:22661:x1875765325230208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869881.547577:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788869881.547684:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325230208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869881.547718:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325230336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869881.547760:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869881.553715:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e46240 going to sleep for 11 seconds 00000100:00100000:3.0:1788869881.554015:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325230336 00000100:00100000:3.0:1788869881.554028:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325230336 00000100:00100000:3.0:1788869881.554086:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788869881.554096:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:22661:x1875765325230336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869881.554639:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:22661:x1875765325230336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 543us (6876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869881.554647:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788869881.554929:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325230336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788869881.556579:0:25710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788869881.557053:0:22661:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788869881.557080:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869881.557094:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d087f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0886 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869881.557108:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840edb000/0x4c16c38a9b6d087f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0886 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869881.557211:0:22661:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788869881.557214:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e282da78000 from 13 10000000:01000000:1.0:1788869881.557217:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869881.557264:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6d088d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869881.557274:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6d088d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869881.557359:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6d088d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869881.557533:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325230464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869881.557734:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869881.557950:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e46240 going to sleep for 11 seconds 00000100:00100000:3.0:1788869881.558005:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325230464 00000100:00100000:3.0:1788869881.558014:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325230464 00000100:00100000:3.0:1788869881.558057:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788869881.558066:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+21:22661:x1875765325230464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788869881.558081:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869881.558096:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840c7ee00/0x4c16c38a9b6d0894 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d088d expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869881.561683:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840c7ee00/0x4c16c38a9b6d0894 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d088d expref: 22 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869881.561712:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840c7ee00/0x4c16c38a9b6d0894 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d088d expref: 22 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869881.561724:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7ee00, rc 0) 00000100:00100000:3.0:1788869881.562079:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:22661:x1875765325230464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4012us (4342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869881.562089:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788869881.562576:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325230464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869881.562704:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6d088d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0894 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869881.562718:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6d088d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d0894 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869881.563007:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702929880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325230592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869881.563063:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869881.563179:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802aac900 going to sleep for 11 seconds 00000100:00100000:1.0:1788869881.563266:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325230592 00000100:00100000:1.0:1788869881.563274:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325230592 00000100:00100000:1.0:1788869881.563322:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788869881.563332:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:22661:x1875765325230592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869881.563456:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:22661:x1875765325230592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869881.563464:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788869881.563627:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702929880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325230592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869881.563675:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702929880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325230720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869881.563718:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869881.563735:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802aac900 going to sleep for 11 seconds 00000100:00100000:1.0:1788869881.563791:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325230720 00000100:00100000:1.0:1788869881.563796:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325230720 00000100:00100000:1.0:1788869881.563826:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788869881.563832:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:22661:x1875765325230720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869881.563908:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:22661:x1875765325230720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869881.563922:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788869881.564419:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702929880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325230720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788869881.566580:0:25711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788869881.568686:0:22661:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788869881.568747:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788869881.568768:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6d088d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0894 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869881.568785:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840edaa00/0x4c16c38a9b6d088d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d0894 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788869881.568802:0:22661:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788869881.568805:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e2704079800 from 13 10000000:01000000:1.0:1788869881.568808:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788869881.568872:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6d089b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869881.568881:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6d089b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869881.568893:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6d089b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869881.568922:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325230848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788869881.569023:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869881.569074:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e46600 going to sleep for 11 seconds 00000100:00100000:2.0:1788869881.569186:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325230848 00000100:00100000:2.0:1788869881.569195:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325230848 00000100:00100000:2.0:1788869881.569271:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788869881.569281:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+22:22661:x1875765325230848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869881.569296:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869881.569309:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28029d6800/0x4c16c38a9b6d08a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d089b expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869881.569332:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28029d6800/0x4c16c38a9b6d08a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d089b expref: 23 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869881.569342:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28029d6800/0x4c16c38a9b6d08a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d089b expref: 23 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869881.569351:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6800, rc 0) 00000100:00100000:2.0:1788869881.569405:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:22661:x1875765325230848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869881.569412:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788869881.569700:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325230848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869881.569717:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6d089b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d08a2 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869881.569726:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6d089b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d08a2 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869881.569815:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325230976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869881.569844:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869881.569874:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e46600 going to sleep for 11 seconds 00000100:00100000:2.0:1788869881.569939:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325230976 00000100:00100000:2.0:1788869881.569944:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325230976 00000100:00100000:2.0:1788869881.569977:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788869881.570079:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:22661:x1875765325230976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788869881.570940:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:22661:x1875765325230976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 950us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869881.570961:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788869881.571324:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325230976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869881.571369:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27040ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325231104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788869881.571418:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869881.571508:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2803e46600 going to sleep for 11 seconds 00000100:00100000:0.0:1788869881.575028:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325231104 00000100:00100000:0.0:1788869881.575047:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325231104 00000100:00100000:0.0:1788869881.575115:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788869881.575126:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:22661:x1875765325231104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869881.575572:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:22661:x1875765325231104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 444us (4150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869881.575580:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788869881.575743:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27040ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325231104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788869881.579379:0:25712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788869881.582959:0:22661:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788869881.583028:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788869881.583043:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6d089b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d08a2 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869881.583057:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2840eda600/0x4c16c38a9b6d089b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d08a2 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788869881.583071:0:22661:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788869881.583075:0:22661:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e283b011000 from 13 10000000:01000000:0.0:1788869881.583077:0:22661:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788869881.583127:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6d08a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869881.583137:0:22661:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6d08a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869881.583148:0:22661:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6d08a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869881.583188:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702929880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325231232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788869881.583277:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869881.583319:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802aacf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869881.583440:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325231232 00000100:00100000:2.0:1788869881.583452:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325231232 00000100:00100000:2.0:1788869881.583523:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788869881.583534:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+23:22661:x1875765325231232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788869881.583550:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869881.583564:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e28029d6600/0x4c16c38a9b6d08b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c16c38a9b6d08a9 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869881.583617:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e28029d6600/0x4c16c38a9b6d08b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4c16c38a9b6d08a9 expref: 24 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869881.583628:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e28029d6600/0x4c16c38a9b6d08b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4c16c38a9b6d08a9 expref: 24 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869881.583636:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6600, rc 0) 00000100:00100000:2.0:1788869881.583714:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:22661:x1875765325231232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869881.583720:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788869881.583937:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702929880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325231232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869881.583953:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6d08a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d08b0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869881.583963:0:22661:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6d08a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4c16c38a9b6d08b0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869881.584142:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702929880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325231360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869881.584324:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869881.584396:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802aacf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788869881.593494:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325231360 00000100:00100000:1.0:1788869881.593515:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325231360 00000100:00100000:1.0:1788869881.593607:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788869881.593620:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:22661:x1875765325231360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869881.593846:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:22661:x1875765325231360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (9521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869881.593855:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788869881.593984:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702929880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325231360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788869881.594053:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702929880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325231488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788869881.594105:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869881.594140:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802aacf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788869881.594887:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325231488 00000100:00100000:2.0:1788869881.594898:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325231488 00000100:00100000:2.0:1788869881.595052:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788869881.595063:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:22661:x1875765325231488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788869881.595223:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:22661:x1875765325231488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869881.595230:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788869881.595244:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702929880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c082ff99-6a3f-4428-a6f2-973bbd93c10a:22661:1875765325231488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788869881.599525:0:25713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788869881.599694:0:22661:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788869881.599725:0:22661:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788869881.599738:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6d08a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d08b0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869881.599753:0:22661:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.154@tcp lock: ffff8e2800030e00/0x4c16c38a9b6d08a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4c16c38a9b6d08b0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869881.671894:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788869881.671920:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325231616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869881.671997:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869881.672111:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325231616 00000100:00100000:1.0:1788869881.672120:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325231616 00000100:00100000:1.0:1788869881.672205:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788869881.672216:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325231616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788869881.672259:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788869881.672314:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325231616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869881.672321:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788869881.672383:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325231616:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788869881.673042:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788869881.799108:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788869881.981760:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869881.981876:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305179392 00000100:00100000:1.0:1788869881.981888:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305179392 00000100:00100000:1.0:1788869881.981959:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 163 00000100:00100000:1.0:1788869881.981971:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+11:18126:x1875765305179392:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788869881.982002:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869881.982024:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2840edae00/0x4c16c38a9b6d08b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca433 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869881.982055:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2840edae00/0x4c16c38a9b6d08b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca433 expref: 12 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869881.982067:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2840edae00/0x4c16c38a9b6d08b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca433 expref: 12 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869881.982076:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edae00, rc 0) 00000100:00100000:1.0:1788869881.982147:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+12:18126:x1875765305179392:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 179us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869881.982155:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 163 00000100:00100000:2.0:1788869881.996371:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869881.999495:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305179520 00000100:00100000:1.0:1788869881.999512:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305179520 00000100:00100000:1.0:1788869881.999628:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00100000:1.0:1788869881.999639:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+12:18126:x1875765305179520:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869881.999844:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+12:18126:x1875765305179520:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 206us (3484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869881.999852:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 164 00000100:00100000:0.0:1788869882.002738:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869882.002826:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305179648 00000100:00100000:3.0:1788869882.002838:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305179648 00000100:00100000:3.0:1788869882.002893:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 165 00000100:00100000:3.0:1788869882.002902:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+12:18126:x1875765305179648:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869882.003053:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+12:18126:x1875765305179648:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 151us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869882.003061:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 165 00000100:00100000:2.0:1788869882.031273:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869882.031438:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305179776 00000100:00100000:0.0:1788869882.031449:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305179776 00000100:00100000:0.0:1788869882.031515:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:0.0:1788869882.031525:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+12:18126:x1875765305179776:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788869882.031545:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869882.031565:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e2800031a00/0x4c16c38a9b6d08be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca43a expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.031630:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e2800031a00/0x4c16c38a9b6d08be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca43a expref: 13 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.031641:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e2800031a00/0x4c16c38a9b6d08be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca43a expref: 13 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.031663:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2800031a00, rc 0) 00000100:00100000:0.0:1788869882.031747:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:18126:x1875765305179776:12345-192.168.204.54@tcp:101:ll_cfg_requeue.0 Request processed in 223us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869882.031754:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 166 00000100:00100000:2.0:1788869882.039689:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869882.044385:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305179904 00000100:00100000:1.0:1788869882.044476:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305179904 00000100:00100000:1.0:1788869882.044571:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:1.0:1788869882.044583:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:18126:x1875765305179904:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788869882.045016:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:18126:x1875765305179904:12345-192.168.204.54@tcp:501:ll_cfg_requeue.0 Request processed in 433us (5334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869882.045026:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 167 00000100:00100000:1.0:1788869882.067848:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869882.068019:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305180032 00000100:00100000:3.0:1788869882.068029:0:22657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305180032 00000100:00100000:3.0:1788869882.068089:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:3.0:1788869882.068100:0:22657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:18126:x1875765305180032:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788869882.068279:0:22657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:18126:x1875765305180032:12345-192.168.204.54@tcp:503:ll_cfg_requeue.0 Request processed in 180us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869882.068287:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 168 00000100:00100000:2.0:1788869882.515934:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869882.516091:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305180160 00000100:00100000:1.0:1788869882.516107:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305180160 00000100:00100000:1.0:1788869882.516561:0:24506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:1.0:1788869882.516576:0:24506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+6:18749:x1875765305180160:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869882.516649:0:24506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869882.516942:0:24506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d08c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca441 expref: -99 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.517050:0:24506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d08cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.517073:0:24506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d08cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.517093:0:24506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d08cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.517113:0:24506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d08d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.517121:0:24506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d08d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.517715:0:24506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d08d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.520073:0:24506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda200/0x4c16c38a9b6d08da lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.520105:0:24506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda200/0x4c16c38a9b6d08da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.520191:0:24506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda200/0x4c16c38a9b6d08da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869882.520331:0:24506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788869882.520336:0:24506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869882.520531:0:24506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda200/0x4c16c38a9b6d08da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.520549:0:24506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d08cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.520557:0:24506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d08cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.520565:0:24506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d08cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.520571:0:24506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edbe00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869882.520576:0:24506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d08cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.520584:0:24506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d08cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.520672:0:24506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ef8900) 00010000:00010000:1.0:1788869882.520675:0:24506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869882.520682:0:24506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d08cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.520689:0:24506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d08cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.520714:0:24506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d08d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.520721:0:24506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d08d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.520800:0:24506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d08d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.520807:0:24506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edac00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869882.520810:0:24506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d08d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.520817:0:24506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d08d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.520826:0:24506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e2701ef7700) 00010000:00010000:1.0:1788869882.520829:0:24506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869882.520834:0:24506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d08d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.520840:0:24506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d08d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.520990:0:24506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d08c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca441 expref: 8 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.521009:0:24506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda200/0x4c16c38a9b6d08da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca441 expref: 7 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.521017:0:24506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e2701ef7c00) 00010000:00010000:1.0:1788869882.521019:0:24506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869882.521022:0:24506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda200, rc 0) 00000100:00100000:1.0:1788869882.522404:0:24506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+7:18749:x1875765305180160:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 5804us (6820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869882.522423:0:24506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:3.0:1788869882.532184:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869882.532303:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305180288 00000100:00100000:1.0:1788869882.532318:0:22676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305180288 00000100:00100000:1.0:1788869882.532402:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1788869882.532413:0:22676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:96d468b1-a138-4403-9587-850a7665da93+7:18749:x1875765305180288:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788869882.532526:0:22676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:96d468b1-a138-4403-9587-850a7665da93+7:18749:x1875765305180288:12345-192.168.204.54@tcp:900:lhsmtool_posix.0 Request processed in 116us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869882.532533:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1788869882.537503:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869882.537680:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305180544 00000100:00100000:1.0:1788869882.537698:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305180544 00000100:00100000:1.0:1788869882.537851:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:1.0:1788869882.537877:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270292bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+7:18749:x1875765305180544:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869882.537912:0:23784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869882.537944:0:23784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d08e1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca448 expref: -99 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.538084:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d08e8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.538105:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d08e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.538123:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d08e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.538141:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d08ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.538149:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d08ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.538157:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d08ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.538315:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6d08f6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.538324:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6d08f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.538330:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6d08f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869882.538341:0:23784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788869882.541714:0:23784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d08e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.541763:0:23784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d08e8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.541773:0:23784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d08e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.541780:0:23784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edac00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869882.541786:0:23784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d08e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.541797:0:23784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d08e8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.541820:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e2701ef7c00) 00010000:00010000:1.0:1788869882.541823:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869882.541828:0:23784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d08e8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.541835:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d08e8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.541857:0:23784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d08ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.541864:0:23784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d08ef lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.541871:0:23784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d08ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.541876:0:23784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edbe00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869882.541882:0:23784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d08ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.541889:0:23784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d08ef lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.541896:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e2701ef7700) 00010000:00010000:1.0:1788869882.541898:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869882.541901:0:23784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d08ef lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.541907:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d08ef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.544101:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d08e1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca448 expref: 10 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.544143:0:23784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbc00/0x4c16c38a9b6d08f6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca448 expref: 9 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.544154:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2701ef7300) 00010000:00010000:1.0:1788869882.544157:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869882.544161:0:23784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edbc00, rc 0) 00000100:00100000:1.0:1788869882.544284:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270292bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+9:18749:x1875765305180544:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 6418us (6788us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788869882.544295:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 24 00000100:00100000:0.0:1788869882.553748:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869882.554124:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305180672 00000100:00100000:3.0:1788869882.554169:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305180672 00000100:00100000:3.0:1788869882.554269:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:3.0:1788869882.554282:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96d468b1-a138-4403-9587-850a7665da93+9:18749:x1875765305180672:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788869882.554450:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96d468b1-a138-4403-9587-850a7665da93+9:18749:x1875765305180672:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 171us (2508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869882.554460:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:0.0:1788869882.562068:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869882.562202:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305180800 00000100:00100000:1.0:1788869882.562217:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305180800 00000100:00100000:1.0:1788869882.562310:0:24506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:1.0:1788869882.562322:0:24506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+5:18749:x1875765305180800:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1788869882.568892:0:24506:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6488us 00000100:00100000:1.0:1788869882.619048:0:24506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+5:18749:x1875765305180800:12345-192.168.204.54@tcp:59:lhsmtool_posix.0 Request processed in 56707us (56984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869882.619070:0:24506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:1.0:1788869882.658414:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869882.658559:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305180928 00000100:00100000:2.0:1788869882.658573:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305180928 00000100:00100000:2.0:1788869882.658735:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:2.0:1788869882.658748:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+9:18755:x1875765305180928:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869882.658778:0:23784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869882.658815:0:23784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0904 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca44f expref: -99 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869882.658925:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d090b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869882.658948:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d090b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869882.658967:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d090b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.664820:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0912 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.664846:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0912 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.664859:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0912 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.664920:0:23784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d090b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.664928:0:23784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d090b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.664937:0:23784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d090b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.664944:0:23784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869882.664948:0:23784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d090b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.664956:0:23784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d090b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.664967:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ef8900) 00010000:00010000:0.0:1788869882.664985:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869882.664994:0:23784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d090b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.665000:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d090b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.665020:0:23784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0912 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.665026:0:23784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0912 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.665032:0:23784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0912 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.665037:0:23784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800031800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869882.665039:0:23784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0912 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.665045:0:23784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0912 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.665053:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8e2803b9bf00) 00010000:00010000:0.0:1788869882.665055:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869882.665059:0:23784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0912 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.665065:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0912 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.665125:0:23784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0904 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca44f expref: 10 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.665146:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ef8900) 00010000:00010000:0.0:1788869882.665148:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869882.665152:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0904 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca44f expref: 10 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.665161:0:23784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6400, rc 0) 00000100:00100000:0.0:1788869882.665245:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+9:18755:x1875765305180928:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 6499us (6851us total) trans 0 rc 301/301 00000100:00100000:0.0:1788869882.665256:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:0.0:1788869882.669998:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869882.670336:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305181056 00000100:00100000:1.0:1788869882.670349:0:22673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305181056 00000100:00100000:1.0:1788869882.670546:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:1.0:1788869882.670577:0:22673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:96d468b1-a138-4403-9587-850a7665da93+9:18755:x1875765305181056:12345-192.168.204.54@tcp:700:lfs.0 00000100:00100000:1.0:1788869882.670736:0:22673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:96d468b1-a138-4403-9587-850a7665da93+9:18755:x1875765305181056:12345-192.168.204.54@tcp:700:lfs.0 Request processed in 178us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869882.670744:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1788869882.679471:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869882.679655:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305181312 00000100:00100000:0.0:1788869882.679673:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305181312 00000100:00100000:0.0:1788869882.679768:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:0.0:1788869882.679781:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+9:18755:x1875765305181312:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:0.0:1788869882.679866:0:22666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869882.679905:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0832 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca3bc expref: 9 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.679935:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ef8900) 00010000:00010000:0.0:1788869882.679945:0:22666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869882.680031:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0919 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.680050:0:22666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0871 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca42c expref: 5 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.680083:0:22666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0919 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.680134:0:22666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0871 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca42c expref: 5 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.680150:0:22666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0871 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca42c expref: 5 pid: 23784 timeout: 916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869882.680170:0:22666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702928a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22666:1875765325231744:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869882.680299:0:22666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802aacf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788869882.688422:0:22666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702928a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22666:1875765325231744:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869882.688468:0:22666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0919 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869882.693551:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869882.693882:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305181440 00000100:00100000:1.0:1788869882.693893:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305181440 00010000:00010000:1.0:1788869882.693947:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0871 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca42c expref: 6 pid: 23784 timeout: 916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869882.694183:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325231872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788869882.694262:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869882.694416:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:1.0:1788869882.694428:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f058e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:2409:x1875765305181440:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869882.694448:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869882.694457:0:22651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0871 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca42c expref: 6 pid: 23784 timeout: 916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.694475:0:22651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0871 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca42c expref: 6 pid: 23784 timeout: 916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.694504:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0871 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca42c expref: 6 pid: 23784 timeout: 916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.694550:0:22651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ef8900) 00010000:00010000:1.0:1788869882.694556:0:22651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0919 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.694567:0:22651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0919 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.694576:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0919 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.694782:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869882.694888:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f058e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:2409:x1875765305181440:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 414us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869882.694900:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00010000:00010000:2.0:1788869882.695011:0:22666:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0919 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869882.695021:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0919 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869882.695052:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0920 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869882.695063:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0920 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869882.695081:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0920 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869882.698428:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325231872 00000100:00100000:1.0:1788869882.698451:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325231872 00000100:00080000:2.0:1788869882.698539:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869882.698546:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788869882.698559:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f058380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325231872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788869882.698613:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788869882.699038:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f058380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325231872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 481us (4774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869882.699047:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788869882.699434:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325231872:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788869882.703449:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6d0927 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.703494:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6d0927 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.703518:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6d0927 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869882.703551:0:22666:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000225f0e5f reply state 0000000089e6478f transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6d0927 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.703566:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6d0927 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.703575:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8e270365c400) 00010000:00010000:3.0:1788869882.703578:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788869882.703605:0:22666:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788869882.703614:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788869882.703628:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0919 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.703670:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0919 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.703678:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0919 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.703685:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800031800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869882.703691:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0919 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.703702:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0919 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.703716:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ef8900) 00010000:00010000:3.0:1788869882.704421:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869882.704430:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0919 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.704439:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0919 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788869882.704469:0:22666:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000225f0e5f reply state 0000000089e6478f transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0920 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.704481:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0920 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.704489:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8e2803b9b500) 00010000:00010000:3.0:1788869882.704492:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788869882.704495:0:22666:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788869882.704889:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+10:18755:x1875765305181312:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 25103us (25419us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788869882.704916:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00010000:00010000:2.0:1788869882.824667:0:25255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869882.898908:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869882.899194:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305181568 00000100:00100000:1.0:1788869882.899209:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305181568 00000100:00100000:1.0:1788869882.899302:0:24506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:1.0:1788869882.899316:0:24506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+10:18763:x1875765305181568:12345-192.168.204.54@tcp:101:lctl.0 00010000:00010000:1.0:1788869882.899354:0:24506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869882.899406:0:24506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d092e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca456 expref: -99 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.899500:0:24506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d0935 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.899518:0:24506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d0935 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.899532:0:24506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d0935 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869882.899669:0:24506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788869882.899674:0:24506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869882.899723:0:24506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d0935 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.899759:0:24506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d092e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca456 expref: 12 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.899787:0:24506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edb400/0x4c16c38a9b6d0935 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca456 expref: 11 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869882.899796:0:24506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ef7700) 00010000:00010000:1.0:1788869882.899800:0:24506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869882.899804:0:24506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edb400, rc 0) 00000100:00100000:1.0:1788869882.899898:0:24506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+11:18763:x1875765305181568:12345-192.168.204.54@tcp:101:lctl.0 Request processed in 586us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869882.899906:0:24506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:1.0:1788869882.954200:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869882.954328:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305181696 00000100:00100000:0.0:1788869882.954344:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305181696 00000100:00100000:0.0:1788869882.954431:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:0.0:1788869882.954450:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:18764:x1875765305181696:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788869882.954483:0:23784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869882.954519:0:23784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d093c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca45d expref: -99 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.954666:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031600/0x4c16c38a9b6d0943 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.954696:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031600/0x4c16c38a9b6d0943 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.954713:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031600/0x4c16c38a9b6d0943 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869882.954786:0:23784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788869882.954791:0:23784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869882.954825:0:23784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031600/0x4c16c38a9b6d0943 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.954859:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d093c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca45d expref: 7 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.954885:0:23784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031600/0x4c16c38a9b6d0943 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca45d expref: 6 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869882.954894:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ef7700) 00010000:00010000:0.0:1788869882.954898:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788869882.954903:0:23784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2800031600, rc 0) 00000100:00100000:0.0:1788869882.955056:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:18764:x1875765305181696:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 613us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869882.955066:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:2.0:1788869882.963834:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869882.964168:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305181824 00000100:00100000:3.0:1788869882.964317:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305181824 00000100:00100000:3.0:1788869882.964453:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:3.0:1788869882.964467:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:18764:x1875765305181824:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788869882.964497:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869882.964528:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6d094a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca464 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.964686:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6d0951 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.964705:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6d0951 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.964732:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6d0951 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.964746:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6d0958 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.964753:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6d0958 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.964885:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6d0958 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.964996:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6d095f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.965036:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6d095f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.965044:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6d095f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869882.965105:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788869882.965111:0:22666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788869882.965139:0:22666:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6d095f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.965155:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6d0951 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.965163:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6d0951 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.965171:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6d0951 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.965178:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869882.965195:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6d0951 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.965204:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6d0951 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.965228:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ef7700) 00010000:00010000:3.0:1788869882.965232:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869882.965239:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6d0951 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.965258:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6d0951 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.965281:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6d0958 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.965288:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6d0958 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.965295:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6d0958 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.965301:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869882.965304:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6d0958 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.965310:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6d0958 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.965319:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8e2803b9b500) 00010000:00010000:3.0:1788869882.965321:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869882.965325:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6d0958 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.965331:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6d0958 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.965365:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6d094a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca464 expref: 8 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.965395:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6d095f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca464 expref: 7 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869882.965404:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8e270365c400) 00010000:00010000:3.0:1788869882.965406:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788869882.965409:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7e000, rc 0) 00000100:00100000:3.0:1788869882.965513:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e29a08ad-0316-4442-93c9-d46ea76b83fc+7:18764:x1875765305181824:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 1048us (1768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869882.965523:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:0.0:1788869882.974453:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869882.974558:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305181952 00000100:00100000:1.0:1788869882.974574:0:22676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305181952 00000100:00100000:1.0:1788869882.974861:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1788869882.974874:0:22676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:18764:x1875765305181952:12345-192.168.204.54@tcp:900:lfs.0 00000100:00100000:1.0:1788869882.974989:0:22676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:18764:x1875765305181952:12345-192.168.204.54@tcp:900:lfs.0 Request processed in 118us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869882.974999:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:1.0:1788869882.986836:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869882.988010:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305182208 00000100:00100000:2.0:1788869882.988036:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305182208 00000100:00100000:2.0:1788869882.988162:0:24506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:2.0:1788869882.988178:0:24506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e29a08ad-0316-4442-93c9-d46ea76b83fc+7:18764:x1875765305182208:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:2.0:1788869882.988221:0:24506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869882.988258:0:24506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0966 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca46b expref: -99 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869882.988426:0:24506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788869882.988674:0:24506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0966 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca46b expref: 9 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869882.988692:0:24506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ef7700) 00010000:00010000:2.0:1788869882.988696:0:24506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788869882.988703:0:24506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0966 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca46b expref: 9 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869882.988732:0:24506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6400, rc 0) 00000100:00100000:2.0:1788869882.988838:0:24506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e29a08ad-0316-4442-93c9-d46ea76b83fc+8:18764:x1875765305182208:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 664us (2020us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788869882.988847:0:24506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:3.0:1788869882.995452:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869882.995559:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305182464 00000100:00100000:2.0:1788869882.995575:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305182464 00000100:00100000:2.0:1788869882.995723:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:2.0:1788869882.995736:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e29a08ad-0316-4442-93c9-d46ea76b83fc+8:18764:x1875765305182464:12345-192.168.204.54@tcp:36:lfs.0 00010000:00010000:2.0:1788869882.995817:0:22664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869882.995854:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e000/0x4c16c38a9b6d095f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca464 expref: 8 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869882.995878:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8e270365c400) 00010000:00010000:2.0:1788869882.995885:0:22664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788869882.995917:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0974 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869882.995933:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0974 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869882.995945:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0974 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869882.996208:0:22664:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009fd42339 reply state 00000000e9980d46 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0974 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869882.996223:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0974 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869882.996230:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8e270365c400) 00010000:00010000:2.0:1788869882.996233:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788869882.996237:0:22664:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788869882.996248:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788869882.996363:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e29a08ad-0316-4442-93c9-d46ea76b83fc+9:18764:x1875765305182464:12345-192.168.204.54@tcp:36:lfs.0 Request processed in 629us (928us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788869882.996392:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:0.0:1788869883.002390:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869883.002545:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305182720 00000100:00100000:3.0:1788869883.002559:0:22667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305182720 00000100:00100000:3.0:1788869883.002693:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:3.0:1788869883.002706:0:22667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270292b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e29a08ad-0316-4442-93c9-d46ea76b83fc+9:18764:x1875765305182720:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788869883.003044:0:22667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270292b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e29a08ad-0316-4442-93c9-d46ea76b83fc+10:18764:x1875765305182720:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 340us (671us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788869883.003053:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00080000:2.0:1788869883.003177:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869883.008494:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869883.008971:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305182976 00000100:00100000:3.0:1788869883.008987:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305182976 00000100:00100000:3.0:1788869883.009072:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:3.0:1788869883.009085:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27040a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e29a08ad-0316-4442-93c9-d46ea76b83fc+10:18764:x1875765305182976:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:3.0:1788869883.009117:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788869883.009144:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6d097b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca472 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.009409:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6d0982 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.009428:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6d0982 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.009443:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6d0982 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.009457:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6d0989 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.009465:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6d0989 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.009472:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6d0989 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788869883.009691:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788869883.010868:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6d0982 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.010884:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6d0982 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.010892:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6d0982 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.010898:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f200 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869883.010904:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6d0982 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.010930:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6d0982 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.010950:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ef7700) 00010000:00010000:3.0:1788869883.010954:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869883.010961:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6d0982 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.010969:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f200/0x4c16c38a9b6d0982 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.010991:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6d0989 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.010997:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6d0989 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.011003:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6d0989 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.011008:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7e400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:3.0:1788869883.011011:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6d0989 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.011018:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6d0989 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.011025:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8e2803b9b500) 00010000:00010000:3.0:1788869883.011028:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788869883.011031:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6d0989 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.011048:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7e400/0x4c16c38a9b6d0989 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.013087:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6d097b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca472 expref: 12 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.013122:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ef7700) 00010000:00010000:2.0:1788869883.013126:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788869883.013132:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7ea00/0x4c16c38a9b6d097b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca472 expref: 12 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.013154:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840c7ea00, rc 0) 00000100:00100000:2.0:1788869883.013406:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27040a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e29a08ad-0316-4442-93c9-d46ea76b83fc+11:18764:x1875765305182976:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 4321us (4925us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1788869883.013417:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 34 00000100:00100000:0.0:1788869883.018152:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869883.019054:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305183104 00000100:00100000:1.0:1788869883.019072:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305183104 00000100:00100000:1.0:1788869883.019316:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:1.0:1788869883.019330:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270292a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e29a08ad-0316-4442-93c9-d46ea76b83fc+11:18764:x1875765305183104:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788869883.019362:0:23784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869883.019392:0:23784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d0997 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca479 expref: -99 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.019534:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d099e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.019553:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d099e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.019568:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d099e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869883.019651:0:23784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788869883.019655:0:23784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869883.019688:0:23784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d099e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.019859:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d0997 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca479 expref: 13 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.019885:0:23784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d099e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca479 expref: 12 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.019894:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8e270365c400) 00010000:00010000:1.0:1788869883.019897:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869883.019902:0:23784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edba00, rc 0) 00000100:00100000:1.0:1788869883.020004:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270292a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e29a08ad-0316-4442-93c9-d46ea76b83fc+12:18764:x1875765305183104:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 677us (1867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869883.020012:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 35 00000100:00100000:0.0:1788869883.026552:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869883.026748:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305183232 00000100:00100000:3.0:1788869883.026763:0:22667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305183232 00000100:00100000:3.0:1788869883.026836:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:3.0:1788869883.026847:0:22667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270292b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e29a08ad-0316-4442-93c9-d46ea76b83fc+12:18764:x1875765305183232:12345-192.168.204.54@tcp:37:lfs.0 00000100:00100000:3.0:1788869883.041666:0:22667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270292b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e29a08ad-0316-4442-93c9-d46ea76b83fc+12:18764:x1875765305183232:12345-192.168.204.54@tcp:37:lfs.0 Request processed in 14798us (15113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869883.041688:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:0.0:1788869883.061962:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869883.065449:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305183488 00000100:00100000:1.0:1788869883.065474:0:22668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305183488 00000100:00100000:1.0:1788869883.066119:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:1.0:1788869883.066138:0:22668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280e1ebc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e29a08ad-0316-4442-93c9-d46ea76b83fc+12:18764:x1875765305183488:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788869883.066523:0:22668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280e1ebc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e29a08ad-0316-4442-93c9-d46ea76b83fc+13:18764:x1875765305183488:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 390us (4579us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788869883.066533:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 4 00000100:00100000:0.0:1788869883.135415:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869883.135515:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305183616 00000100:00100000:3.0:1788869883.135529:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305183616 00000100:00080000:2.0:1788869883.135608:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788869883.135684:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:3.0:1788869883.135699:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270292b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96d468b1-a138-4403-9587-850a7665da93+11:18770:x1875765305183616:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788869883.136285:0:22665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869883.136316:0:22665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d09a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca480 expref: -99 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136408:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136425:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136442:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136455:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136483:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136492:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136649:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731e00/0x4c16c38a9b6d09ba lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136659:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731e00/0x4c16c38a9b6d09ba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136666:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731e00/0x4c16c38a9b6d09ba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869883.136709:0:22665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788869883.136721:0:22665:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869883.136773:0:22665:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731e00/0x4c16c38a9b6d09ba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136789:0:22665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136796:0:22665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09ac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136802:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136809:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e280a730a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869883.136814:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136830:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136845:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ef7700) 00010000:00010000:2.0:1788869883.136848:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869883.136854:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136860:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136878:0:22665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136884:0:22665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136890:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136896:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e280a730600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869883.136898:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136904:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136910:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8e2803b9b500) 00010000:00010000:2.0:1788869883.136913:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869883.136915:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09b3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136933:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136970:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d09a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca480 expref: 13 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136989:0:22665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731e00/0x4c16c38a9b6d09ba lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca480 expref: 12 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.136998:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8e270365c400) 00010000:00010000:2.0:1788869883.137000:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788869883.137003:0:22665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e280a731e00, rc 0) 00000100:00100000:2.0:1788869883.137106:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270292b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96d468b1-a138-4403-9587-850a7665da93+12:18770:x1875765305183616:12345-192.168.204.54@tcp:101:bash.0 Request processed in 1409us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869883.137116:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 36 00000100:00100000:2.0:1788869883.145510:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869883.145774:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305183744 00000100:00100000:1.0:1788869883.145793:0:22675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305183744 00000100:00100000:1.0:1788869883.145947:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1788869883.145964:0:22675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:96d468b1-a138-4403-9587-850a7665da93+5:18770:x1875765305183744:12345-192.168.204.54@tcp:900:bash.0 00000100:00080000:2.0:1788869883.146009:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869883.146094:0:22675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:96d468b1-a138-4403-9587-850a7665da93+5:18770:x1875765305183744:12345-192.168.204.54@tcp:900:bash.0 Request processed in 135us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869883.146127:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:0.0:1788869883.152060:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869883.153508:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305184000 00000100:00100000:2.0:1788869883.153531:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305184000 00000100:00100000:2.0:1788869883.153701:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:2.0:1788869883.153717:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+12:18770:x1875765305184000:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:2.0:1788869883.153751:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869883.153793:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d09c1 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca487 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.153975:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09c8 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.154018:0:22666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d099e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca479 expref: 12 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.154029:0:22666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09c8 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.154078:0:22666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d099e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca479 expref: 12 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.154096:0:22666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d099e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca479 expref: 12 pid: 23784 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869883.154112:0:22666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22666:1875765325232000:192.168.204.54@tcp:104: 00000100:00100000:2.0:1788869883.154249:0:22666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280833dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788869883.163829:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869883.164721:0:25698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305184128 00000100:00100000:3.0:1788869883.164744:0:25698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305184128 00010000:00010000:3.0:1788869883.164823:0:25698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d099e lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca479 expref: 13 pid: 23784 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869883.164888:0:25698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 16 00000100:00100000:3.0:1788869883.164902:0:25698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702928e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e29a08ad-0316-4442-93c9-d46ea76b83fc+13:2409:x1875765305184128:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869883.164928:0:25698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869883.164939:0:25698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d099e lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca479 expref: 13 pid: 23784 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.164959:0:25698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d099e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca479 expref: 13 pid: 23784 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.165021:0:25698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8e270365c400) 00010000:00010000:3.0:1788869883.165027:0:25698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09c8 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.165039:0:25698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09c8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.165048:0:25698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09c8 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.165357:0:25698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869883.165449:0:25698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702928e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e29a08ad-0316-4442-93c9-d46ea76b83fc+13:2409:x1875765305184128:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 549us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869883.165458:0:25698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 16 00010000:00010000:2.0:1788869883.166199:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d099e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca479 expref: 12 pid: 23784 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869883.166232:0:22666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22666:1875765325232000:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869883.166266:0:22666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09c8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.166277:0:22666:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09c8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.166283:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09c8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.166377:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09cf lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.166406:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09cf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.166417:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09cf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.166982:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730200/0x4c16c38a9b6d09d6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.166993:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730200/0x4c16c38a9b6d09d6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.167002:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730200/0x4c16c38a9b6d09d6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869883.167014:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788869883.167039:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09c8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.167047:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09c8 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.167054:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09c8 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.167060:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e280a730600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869883.167065:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09c8 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.167073:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09c8 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.167099:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8e270365c400) 00010000:00010000:2.0:1788869883.167102:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869883.167107:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09c8 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.167113:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d09c8 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788869883.167125:0:22666:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ce9dd70 reply state 00000000357a9c6d transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09cf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.167136:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09cf lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.167142:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8e2803b9bf00) 00010000:00010000:2.0:1788869883.167145:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788869883.167148:0:22666:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788869883.167189:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d09c1 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca487 expref: 15 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.167204:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730200/0x4c16c38a9b6d09d6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca487 expref: 14 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.167211:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:2.0:1788869883.167214:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788869883.167216:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e280a730200, rc 0) 00000100:00100000:2.0:1788869883.167281:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+15:18770:x1875765305184000:12345-192.168.204.54@tcp:101:bash.0 Request processed in 13568us (15234us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788869883.167291:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 37 00000100:00100000:0.0:1788869883.189349:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869883.192225:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305184256 00000100:00100000:1.0:1788869883.192245:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305184256 00000100:00100000:1.0:1788869883.192343:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:1.0:1788869883.192356:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270292ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+15:18770:x1875765305184256:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788869883.192382:0:23784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869883.192404:0:23784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d09e4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca48e expref: -99 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.192477:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d09eb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.192492:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d09eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.192506:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d09eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869883.192562:0:23784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788869883.192567:0:23784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869883.192754:0:23784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d09eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.192766:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d09eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.192793:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d09e4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca48e expref: 17 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.192814:0:23784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d09eb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca48e expref: 16 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.192841:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:1.0:1788869883.192844:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869883.192847:0:23784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edba00, rc 0) 00000100:00100000:1.0:1788869883.192946:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270292ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+16:18770:x1875765305184256:12345-192.168.204.54@tcp:101:bash.0 Request processed in 592us (3612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869883.192953:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 38 00000100:00100000:3.0:1788869883.200010:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869883.200097:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305184512 00000100:00100000:0.0:1788869883.200114:0:22667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305184512 00000100:00100000:0.0:1788869883.200182:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:0.0:1788869883.200194:0:22667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96d468b1-a138-4403-9587-850a7665da93+16:18770:x1875765305184512:12345-192.168.204.54@tcp:35:bash.0 00000100:00100000:0.0:1788869883.200522:0:22667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96d468b1-a138-4403-9587-850a7665da93+17:18770:x1875765305184512:12345-192.168.204.54@tcp:35:bash.0 Request processed in 330us (527us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1788869883.200530:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 5 00000100:00100000:1.0:1788869883.206055:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325232256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869883.206134:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869883.206166:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325232128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788869883.206285:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270292a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3648:1875765325232384:0@lo:400:kworker.0 00000100:00100000:0.0:1788869883.206334:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869883.206381:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270292b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325232896:0@lo:400:kworker.0 00000100:00100000:2.0:1788869883.206384:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325232384 00000100:00100000:2.0:1788869883.206392:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325232384 00000100:00100000:0.0:1788869883.206429:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869883.206450:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841a36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325233408:0@lo:400:kworker.0 00000100:00100000:0.0:1788869883.206471:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869883.206487:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e27039f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325233920:0@lo:400:kworker.0 00000100:00100000:0.0:1788869883.206506:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869883.206528:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788869883.206533:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270292aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325232512:0@lo:400:kworker.0 00000100:00100000:0.0:1788869883.206556:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869883.206574:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325233024:0@lo:400:kworker.0 00000100:00100000:0.0:1788869883.206611:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869883.206644:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325233536:0@lo:400:kworker.0 00000100:00100000:0.0:1788869883.206673:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869883.206705:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325232896 00000100:00100000:0.0:1788869883.206709:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325232896 00000100:00100000:0.0:1788869883.206745:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325233408 00000100:00100000:0.0:1788869883.206747:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325233408 00000100:00100000:0.0:1788869883.206758:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325233920 00000100:00100000:0.0:1788869883.206760:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325233920 00000100:00100000:0.0:1788869883.206781:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325233536 00000100:00100000:0.0:1788869883.206783:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325233536 00000100:00100000:0.0:1788869883.206799:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788869883.206806:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325232896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869883.206860:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875765325232896:12345-0@lo:400:kworker.0 Request processed in 53us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869883.206867:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788869883.206884:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788869883.206891:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325233408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869883.206917:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875765325233408:12345-0@lo:400:kworker.0 Request processed in 27us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869883.206923:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788869883.206933:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788869883.206938:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325233920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869883.206962:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875765325233920:12345-0@lo:400:kworker.0 Request processed in 24us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869883.206967:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788869883.206977:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788869883.206983:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325233536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869883.207005:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875765325233536:12345-0@lo:400:kworker.0 Request processed in 24us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869883.207017:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1788869883.207036:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788869883.207039:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788869883.207070:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875765325233536:0@lo:400:kworker.0 00000100:00100000:0.0:1788869883.207081:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270292b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875765325232896:0@lo:400:kworker.0 00000100:00100000:0.0:1788869883.207089:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841a36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875765325233408:0@lo:400:kworker.0 00010000:00080000:0.0:1788869883.207100:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e27039f2a00 x1875765325233920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788869883.207109:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e27039f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875765325233920:0@lo:400:kworker.0 00000100:00100000:0.0:1788869883.207156:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325232512 00000100:00100000:0.0:1788869883.207160:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325232512 00000100:00100000:0.0:1788869883.207184:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325233024 00000100:00100000:0.0:1788869883.207187:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325233024 00000100:00100000:0.0:1788869883.207200:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788869883.207206:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325232512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869883.207243:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325232512:12345-0@lo:400:kworker.0 Request processed in 36us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869883.207248:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788869883.207259:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788869883.207265:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325233024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788869883.207291:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875765325233024:12345-0@lo:400:kworker.0 Request processed in 26us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869883.207297:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788869883.207324:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270292aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325232512:0@lo:400:kworker.0 00000100:00100000:0.0:1788869883.207344:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875765325233024:0@lo:400:kworker.0 00000100:00100000:3.0:1788869883.212013:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325232256 00000100:00100000:3.0:1788869883.212041:0:24178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325232256 00000100:00100000:1.0:1788869883.212093:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270292b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325232768:0@lo:400:kworker.0 00000100:00100000:1.0:1788869883.212187:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869883.212222:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841a36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325233280:0@lo:400:kworker.0 00000100:00100000:1.0:1788869883.212251:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869883.212269:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841a34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765325233792:0@lo:400:kworker.0 00000100:00100000:1.0:1788869883.212295:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869883.212411:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869883.212527:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788869883.212552:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:3648:x1875765325232384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869883.213430:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788869883.213445:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325232640:0@lo:400:kworker.0 00000100:00100000:1.0:1788869883.213491:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869883.213520:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325233152:0@lo:400:kworker.0 00000100:00100000:1.0:1788869883.213547:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869883.213576:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325233664:0@lo:400:kworker.0 00000100:00100000:3.0:1788869883.213611:0:24178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325232128 00000100:00100000:3.0:1788869883.213644:0:24178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325232128 00000100:00100000:1.0:1788869883.213654:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869883.213685:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788869883.213697:0:24178:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841002300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325232256:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788869883.213709:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325232768 00000100:00100000:1.0:1788869883.213718:0:24175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325232768 00000100:00100000:1.0:1788869883.213777:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325233280 00000100:00100000:1.0:1788869883.213780:0:24175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325233280 00000100:00100000:1.0:1788869883.213793:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325232640 00000100:00100000:1.0:1788869883.213796:0:24175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325232640 00000100:00100000:1.0:1788869883.213810:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325233152 00000100:00100000:1.0:1788869883.213812:0:24175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325233152 00000100:00100000:1.0:1788869883.213826:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788869883.213834:0:24175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1875765325232768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869883.213881:0:24175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1875765325232768:12345-0@lo:400:kworker.0 Request processed in 48us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869883.213887:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788869883.213904:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788869883.213910:0:24175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841001880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1875765325233280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869883.213936:0:24175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841001880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1875765325233280:12345-0@lo:400:kworker.0 Request processed in 26us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869883.213941:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788869883.213953:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788869883.213959:0:24175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702a61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325232640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869883.213986:0:24175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702a61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325232640:12345-0@lo:400:kworker.0 Request processed in 27us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869883.213991:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788869883.214002:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788869883.214008:0:24175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702a60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325233152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788869883.214032:0:24175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702a60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325233152:12345-0@lo:400:kworker.0 Request processed in 25us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869883.214037:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788869883.214087:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325232640:0@lo:400:kworker.0 00000100:00100000:1.0:1788869883.214108:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325233152:0@lo:400:kworker.0 00000100:00100000:1.0:1788869883.214119:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270292b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325232768:0@lo:400:kworker.0 00000100:00100000:1.0:1788869883.214146:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841a36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325233280:0@lo:400:kworker.0 00000100:00100000:1.0:1788869883.214181:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325233792 00000100:00100000:1.0:1788869883.214185:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325233792 00000100:00100000:1.0:1788869883.214228:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325233664 00000100:00100000:1.0:1788869883.214232:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325233664 00000100:00100000:1.0:1788869883.214256:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788869883.214264:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765325233792:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788869883.214278:0:24178:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788869883.214335:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875765325233792:12345-0@lo:400:kworker.0 Request processed in 70us (2036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869883.214343:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788869883.214368:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788869883.214376:0:24178:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841002300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875765325232256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 675us (8235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869883.214389:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325233664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869883.214397:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788869883.214430:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788869883.214441:0:24178:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325232128:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869883.214448:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875765325233664:12345-0@lo:400:kworker.0 Request processed in 64us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869883.214462:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00002000:00000024:3.0:1788869883.214483:0:24178:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00010000:00080000:1.0:1788869883.214509:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2841a37b80 x1875765325233664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869883.214524:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875765325233664:0@lo:400:kworker.0 00000100:00100000:3.0:1788869883.214538:0:24178:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325232128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (2124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869883.214545:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841a34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875765325233792:0@lo:400:kworker.0 00000100:00100000:3.0:1788869883.214549:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788869883.214618:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325232256:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788869883.214708:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788869883.214719:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788869883.214722:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788869883.214725:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788869883.217425:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325232128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869883.217758:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:3648:x1875765325232384:12345-0@lo:400:kworker.0 Request processed in 5215us (11419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869883.217771:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788869883.217980:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270292a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3648:1875765325232384:0@lo:400:kworker.0 00000100:00100000:3.0:1788869883.397783:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869883.398034:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305184768 00000100:00100000:0.0:1788869883.398045:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305184768 00000100:00100000:0.0:1788869883.398103:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:0.0:1788869883.398114:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+17:18780:x1875765305184768:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:0.0:1788869883.398145:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869883.398167:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d09f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca495 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869883.398281:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788869883.398388:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d09f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca495 expref: 19 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869883.398390:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788869883.398403:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ef7700) 00010000:00010000:0.0:1788869883.398407:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788869883.398412:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d09f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca495 expref: 19 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869883.398424:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2800030000, rc 0) 00000100:00100000:0.0:1788869883.398485:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+18:18780:x1875765305184768:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 372us (714us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1788869883.398492:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 39 00000100:00100000:2.0:1788869883.404031:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869883.404130:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305185024 00000100:00100000:0.0:1788869883.404142:0:22667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305185024 00000100:00100000:0.0:1788869883.404235:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:0.0:1788869883.404246:0:22667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96d468b1-a138-4403-9587-850a7665da93+18:18780:x1875765305185024:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1788869883.404878:0:22667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96d468b1-a138-4403-9587-850a7665da93+19:18780:x1875765305185024:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 631us (855us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1788869883.404887:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 6 00000100:00100000:3.0:1788869883.495716:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869883.495863:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305185280 00000100:00100000:1.0:1788869883.495874:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305185280 00000100:00100000:1.0:1788869883.495946:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:1.0:1788869883.495958:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96d468b1-a138-4403-9587-850a7665da93+19:18783:x1875765305185280:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788869883.495983:0:22665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869883.496005:0:22665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d0a00 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca49c expref: -99 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.496114:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d0a07 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.496128:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d0a07 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.496140:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d0a07 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869883.496152:0:22665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788869883.496276:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d0a00 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca49c expref: 22 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.496305:0:22665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d0a07 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca49c expref: 21 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.496313:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:1.0:1788869883.496331:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869883.496334:0:22665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840eda400, rc 0) 00000100:00100000:1.0:1788869883.496393:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96d468b1-a138-4403-9587-850a7665da93+21:18783:x1875765305185280:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 437us (699us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1788869883.496400:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 40 00000100:00100000:3.0:1788869883.499250:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869883.499399:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305185408 00000100:00100000:1.0:1788869883.499411:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305185408 00000100:00100000:1.0:1788869883.499475:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:1.0:1788869883.499487:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+21:18783:x1875765305185408:12345-192.168.204.54@tcp:54:lfs.0 00010000:00010000:1.0:1788869883.499563:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a15 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.499582:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a15 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.499642:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a15 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.499680:0:23784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a15 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.499687:0:23784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a15 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.499695:0:23784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a15 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.499701:0:23784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edac00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869883.499706:0:23784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a15 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.499733:0:23784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a15 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.499746:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:1.0:1788869883.499748:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869883.499754:0:23784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a15 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.499760:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a15 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869883.499971:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+21:18783:x1875765305185408:12345-192.168.204.54@tcp:54:lfs.0 Request processed in 486us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869883.499978:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 41 00000100:00100000:2.0:1788869883.509885:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869883.511657:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305185536 00000100:00100000:3.0:1788869883.511674:0:22649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305185536 00000100:00100000:3.0:1788869883.511758:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:3.0:1788869883.511770:0:22649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96d468b1-a138-4403-9587-850a7665da93+21:2410:x1875765305185536:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869883.511786:0:22649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869883.511815:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d0a07 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca49c expref: 21 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869883.511836:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:3.0:1788869883.511842:0:22649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869883.511905:0:22649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96d468b1-a138-4403-9587-850a7665da93+20:2410:x1875765305185536:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 137us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869883.511912:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:0.0:1788869883.513993:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869883.514070:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305185792 00000100:00100000:1.0:1788869883.514081:0:22668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305185792 00000100:00100000:1.0:1788869883.514142:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 7 00000100:00100000:1.0:1788869883.514153:0:22668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96d468b1-a138-4403-9587-850a7665da93+20:18783:x1875765305185792:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:1.0:1788869883.514432:0:22668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96d468b1-a138-4403-9587-850a7665da93+21:18783:x1875765305185792:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 280us (450us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1788869883.514440:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 7 00000040:00080000:2.0:1788869883.526381:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788869883.718096:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788869883.718129:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702a63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325234048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788869883.718169:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788869883.718180:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2703a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325234176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869883.724176:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869883.724416:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325234176 00000100:00100000:2.0:1788869883.724427:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325234176 00000100:00100000:2.0:1788869883.724490:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788869883.724501:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702a62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325234176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869883.724537:0:22669:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788869883.724667:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702a62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325234176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 168us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869883.724675:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788869883.724729:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2703a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325234176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788869883.726072:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869883.726204:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325234048 00000100:00100000:0.0:1788869883.726213:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325234048 00000100:00100000:0.0:1788869883.726268:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788869883.726277:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325234048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788869883.726432:0:23407:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788869883.726500:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325234048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 225us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869883.726507:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788869883.726622:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702a63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325234048:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788869883.847083:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869883.914906:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869883.917081:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305186048 00000100:00100000:1.0:1788869883.917103:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305186048 00000100:00100000:1.0:1788869883.917640:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:1.0:1788869883.917653:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+21:18814:x1875765305186048:12345-192.168.204.54@tcp:101:cat.0 00010000:00010000:1.0:1788869883.917681:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869883.917705:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a1c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca4a3 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.917839:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d0a23 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.917856:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d0a23 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.917869:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d0a23 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869883.917882:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788869883.918031:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a1c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4a3 expref: 24 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.918072:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d0a23 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4a3 expref: 23 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869883.918082:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:1.0:1788869883.918085:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869883.918089:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840edbe00, rc 0) 00000100:00100000:1.0:1788869883.918155:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+23:18814:x1875765305186048:12345-192.168.204.54@tcp:101:cat.0 Request processed in 506us (3260us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1788869883.918162:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 42 00000100:00100000:3.0:1788869883.922413:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869883.922460:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869883.922550:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305186432 00000100:00100000:3.0:1788869883.922562:0:22668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305186432 00000100:00100000:3.0:1788869883.922677:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:3.0:1788869883.922689:0:22668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96d468b1-a138-4403-9587-850a7665da93+23:18814:x1875765305186432:12345-192.168.204.54@tcp:35:cat.0 00000100:00100000:3.0:1788869883.923048:0:22668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96d468b1-a138-4403-9587-850a7665da93+24:18814:x1875765305186432:12345-192.168.204.54@tcp:35:cat.0 Request processed in 360us (586us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1788869883.923056:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 8 00000100:00100000:2.0:1788869883.924048:0:25698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305186176 00000100:00100000:2.0:1788869883.924058:0:25698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305186176 00000100:00100000:2.0:1788869883.924127:0:25698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:2.0:1788869883.924136:0:25698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f058000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96d468b1-a138-4403-9587-850a7665da93+24:2410:x1875765305186176:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869883.924169:0:25698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869883.924206:0:25698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d0a23 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4a3 expref: 24 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869883.924239:0:25698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:2.0:1788869883.924244:0:25698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869883.925002:0:25698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f058000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96d468b1-a138-4403-9587-850a7665da93+23:2410:x1875765305186176:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 860us (2596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869883.925012:0:25698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 1 00000100:00100000:2.0:1788869884.034682:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869884.034873:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305186688 00000100:00100000:0.0:1788869884.034885:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305186688 00000100:00100000:0.0:1788869884.034958:0:24506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:0.0:1788869884.034977:0:24506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+23:18820:x1875765305186688:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:0.0:1788869884.035006:0:24506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869884.035028:0:24506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0a31 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca4aa expref: -99 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.035153:0:24506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0a38 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.035168:0:24506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0a38 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.035212:0:24506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0a38 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869884.035226:0:24506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788869884.035376:0:24506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0a31 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4aa expref: 26 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.035398:0:24506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0a38 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4aa expref: 25 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.035407:0:24506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:0.0:1788869884.035410:0:24506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869884.035413:0:24506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2800031800, rc 0) 00000100:00100000:0.0:1788869884.035492:0:24506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+25:18820:x1875765305186688:12345-192.168.204.54@tcp:101:dd.0 Request processed in 517us (823us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1788869884.035500:0:24506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 43 00000100:00100000:0.0:1788869884.039772:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869884.039983:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305186816 00000100:00100000:2.0:1788869884.039999:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305186816 00000100:00100000:2.0:1788869884.040081:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:2.0:1788869884.040095:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+25:18820:x1875765305186816:12345-192.168.204.54@tcp:101:dd.0 00010000:00010000:2.0:1788869884.040134:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869884.040160:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731200/0x4c16c38a9b6d0a46 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca4b1 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869884.040222:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731000/0x4c16c38a9b6d0a4d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869884.040240:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731000/0x4c16c38a9b6d0a4d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869884.040255:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731000/0x4c16c38a9b6d0a4d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869884.040410:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731200/0x4c16c38a9b6d0a46 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4b1 expref: 27 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869884.040440:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731000/0x4c16c38a9b6d0a4d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4b1 expref: 26 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869884.040449:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:2.0:1788869884.040452:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788869884.040457:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e280a731000, rc 0) 00000100:00100000:2.0:1788869884.040541:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+26:18820:x1875765305186816:12345-192.168.204.54@tcp:101:dd.0 Request processed in 450us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869884.040549:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 44 00000100:00100000:3.0:1788869884.041310:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869884.042066:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305186944 00000100:00100000:1.0:1788869884.042090:0:22649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305186944 00000100:00100000:0.0:1788869884.042870:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:0.0:1788869884.042887:0:22649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96d468b1-a138-4403-9587-850a7665da93+26:2408:x1875765305186944:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869884.042909:0:22649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869884.042943:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0a38 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4aa expref: 26 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.043333:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:0.0:1788869884.043340:0:22649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869884.043649:0:22649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96d468b1-a138-4403-9587-850a7665da93+25:2408:x1875765305186944:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 763us (2338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869884.043676:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 2 00000100:00100000:2.0:1788869884.045505:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869884.045785:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305187200 00000100:00100000:1.0:1788869884.045796:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305187200 00000100:00100000:1.0:1788869884.045890:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 45 00000100:00100000:1.0:1788869884.045902:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+25:18820:x1875765305187200:12345-192.168.204.54@tcp:36:dd.0 00010000:00010000:1.0:1788869884.045992:0:22664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869884.046025:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d09eb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca48e expref: 25 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.046046:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:1.0:1788869884.046052:0:22664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869884.047071:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a54 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.047093:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a54 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.047106:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a54 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869884.047278:0:22664:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1788869884.047310:0:22664:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eeb727ec reply state 00000000dc76c596 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a54 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.047325:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a54 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.047333:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:1.0:1788869884.047337:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788869884.047342:0:22664:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788869884.047765:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+27:18820:x1875765305187200:12345-192.168.204.54@tcp:36:dd.0 Request processed in 1862us (2265us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1788869884.047795:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 45 00000020:00080000:1.0:1788869884.047801:0:22664:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788869884.138661:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869884.138851:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305187456 00000100:00100000:3.0:1788869884.138861:0:22668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305187456 00000100:00100000:3.0:1788869884.138919:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:3.0:1788869884.138930:0:22668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96d468b1-a138-4403-9587-850a7665da93+27:18820:x1875765305187456:12345-192.168.204.54@tcp:35:dd.0 00000100:00100000:3.0:1788869884.139171:0:22668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96d468b1-a138-4403-9587-850a7665da93+28:18820:x1875765305187456:12345-192.168.204.54@tcp:35:dd.0 Request processed in 242us (583us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1788869884.139179:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 9 00000100:00100000:2.0:1788869884.468750:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869884.468899:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305187584 00000100:00100000:0.0:1788869884.468913:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305187584 00000100:00100000:0.0:1788869884.468999:0:24506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 46 00000100:00100000:0.0:1788869884.469011:0:24506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+28:18835:x1875765305187584:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:0.0:1788869884.469041:0:24506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869884.469066:0:24506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0a5b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca4b8 expref: -99 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469149:0:24506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0a62 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469167:0:24506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0a62 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469193:0:24506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0a62 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469205:0:24506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0a69 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469213:0:24506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0a69 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469220:0:24506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0a69 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469312:0:24506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031000/0x4c16c38a9b6d0a70 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469340:0:24506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031000/0x4c16c38a9b6d0a70 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469347:0:24506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031000/0x4c16c38a9b6d0a70 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869884.469392:0:24506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788869884.469396:0:24506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788869884.469458:0:24506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031000/0x4c16c38a9b6d0a70 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469469:0:24506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031000/0x4c16c38a9b6d0a70 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469478:0:24506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0a62 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469483:0:24506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0a62 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469490:0:24506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0a62 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469497:0:24506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800030800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869884.469501:0:24506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0a62 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469508:0:24506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0a62 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469519:0:24506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8e270365c400) 00010000:00010000:0.0:1788869884.469529:0:24506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869884.469535:0:24506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0a62 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469540:0:24506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0a62 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469556:0:24506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0a69 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469563:0:24506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0a69 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469568:0:24506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0a69 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469573:0:24506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800030000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869884.469575:0:24506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0a69 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469581:0:24506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0a69 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469683:0:24506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8e2803b9bf00) 00010000:00010000:0.0:1788869884.469685:0:24506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869884.469690:0:24506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0a69 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469695:0:24506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0a69 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469727:0:24506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0a5b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4b8 expref: 30 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469758:0:24506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031000/0x4c16c38a9b6d0a70 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4b8 expref: 29 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.469765:0:24506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:0.0:1788869884.469768:0:24506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788869884.469770:0:24506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2800031000, rc 0) 00000100:00100000:0.0:1788869884.469832:0:24506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+29:18835:x1875765305187584:12345-192.168.204.54@tcp:101:stat.0 Request processed in 824us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869884.469839:0:24506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 46 00000040:00080000:2.0:1788869884.552683:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788869884.590992:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869884.591143:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305187840 00000100:00100000:0.0:1788869884.591157:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305187840 00000100:00100000:0.0:1788869884.591235:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 47 00000100:00100000:0.0:1788869884.591249:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+29:18841:x1875765305187840:12345-192.168.204.54@tcp:36:truncate.0 00010000:00010000:0.0:1788869884.591336:0:22666:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869884.591376:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031000/0x4c16c38a9b6d0a70 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4b8 expref: 29 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.591407:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:0.0:1788869884.591414:0:22666:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869884.591726:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0a77 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.591745:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0a77 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.591757:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0a77 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788869884.591822:0:22666:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:0.0:1788869884.591847:0:22666:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1a1a0d6 reply state 000000001639a826 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0a77 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.591860:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0a77 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869884.591868:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:0.0:1788869884.591871:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869884.591874:0:22666:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869884.592250:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+31:18841:x1875765305187840:12345-192.168.204.54@tcp:36:truncate.0 Request processed in 1002us (1328us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1788869884.592260:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 47 00000020:00080000:0.0:1788869884.592265:0:22666:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788869884.830159:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869884.830582:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305187968 00000100:00100000:1.0:1788869884.830641:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305187968 00000100:00100000:1.0:1788869884.830758:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 48 00000100:00100000:1.0:1788869884.830769:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+31:18855:x1875765305187968:12345-192.168.204.54@tcp:101:stat.0 00010000:00010000:1.0:1788869884.830797:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869884.830820:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0a7e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca4bf expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.830893:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d0a85 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.830910:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d0a85 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.830922:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d0a85 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.830933:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d0a8c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.830939:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d0a8c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.830946:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d0a8c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831033:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0a93 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831058:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0a93 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831065:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0a93 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869884.831111:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1788869884.831115:0:22664:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869884.831137:0:22664:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0a93 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831150:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0a93 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831159:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d0a85 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831166:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d0a85 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831173:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d0a85 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831180:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edbe00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869884.831184:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d0a85 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831191:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d0a85 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831203:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8e270365c400) 00010000:00010000:1.0:1788869884.831211:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869884.831216:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d0a85 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831222:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edbe00/0x4c16c38a9b6d0a85 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831237:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d0a8c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831243:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d0a8c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831249:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d0a8c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831254:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840eda400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869884.831257:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d0a8c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831263:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d0a8c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831269:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8e2803b9bf00) 00010000:00010000:1.0:1788869884.831271:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869884.831274:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d0a8c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831280:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840eda400/0x4c16c38a9b6d0a8c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831302:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edba00/0x4c16c38a9b6d0a7e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4bf expref: 33 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831325:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0a93 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4bf expref: 32 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.831333:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:1.0:1788869884.831335:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788869884.831338:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842043400, rc 0) 00000100:00100000:1.0:1788869884.831400:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+32:18855:x1875765305187968:12345-192.168.204.54@tcp:101:stat.0 Request processed in 633us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869884.831407:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 48 00010000:00010000:1.0:1788869884.869950:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869884.979804:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869884.984499:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305188224 00000100:00100000:0.0:1788869884.984522:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305188224 00000100:00100000:1.0:1788869884.985260:0:24506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:1.0:1788869884.985278:0:24506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+32:18865:x1875765305188224:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788869884.985304:0:24506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869884.985441:0:24506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043e00/0x4c16c38a9b6d0a9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca4c6 expref: -99 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869884.985634:0:24506:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788869884.985759:0:24506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043e00/0x4c16c38a9b6d0a9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4c6 expref: 34 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.985773:0:24506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ef7700) 00010000:00010000:1.0:1788869884.985776:0:24506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869884.985782:0:24506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043e00/0x4c16c38a9b6d0a9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4c6 expref: 34 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869884.985800:0:24506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842043e00, rc 0) 00000100:00100000:1.0:1788869884.986017:0:24506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+33:18865:x1875765305188224:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 742us (6227us total) trans 12884901910 rc 301/301 00000100:00100000:1.0:1788869884.986024:0:24506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 49 00000100:00100000:2.0:1788869884.991546:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869884.991792:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305188480 00000100:00100000:3.0:1788869884.991803:0:22668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305188480 00000100:00100000:3.0:1788869884.991876:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:3.0:1788869884.991889:0:22668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2814067850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96d468b1-a138-4403-9587-850a7665da93+33:18865:x1875765305188480:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:3.0:1788869884.992451:0:22668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2814067850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96d468b1-a138-4403-9587-850a7665da93+34:18865:x1875765305188480:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 563us (918us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1788869884.992460:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 10 00000100:00100000:2.0:1788869885.097497:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869885.097778:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305188736 00000100:00100000:0.0:1788869885.097791:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305188736 00000100:00100000:0.0:1788869885.097886:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:0.0:1788869885.097899:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e280138fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+34:18871:x1875765305188736:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788869885.097930:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869885.097954:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031000/0x4c16c38a9b6d0aa8 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca4cd expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.098129:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0aaf lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.098147:0:22666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730200/0x4c16c38a9b6d09d6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca487 expref: 35 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.098187:0:22666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0a93 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4bf expref: 35 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.098199:0:22666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0aaf lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.098239:0:22666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0a93 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4bf expref: 35 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.098255:0:22666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0a93 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4bf expref: 35 pid: 22664 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869885.098270:0:22666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841aa0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22666:1875765325234304:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869885.098382:0:22666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730200/0x4c16c38a9b6d09d6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca487 expref: 35 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.098392:0:22666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730200/0x4c16c38a9b6d09d6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca487 expref: 35 pid: 22666 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869885.098401:0:22666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841aa1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22666:1875765325234432:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869885.098428:0:22666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802aac900 going to sleep for 11 seconds 00000100:00080000:1.0:1788869885.098518:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788869885.103417:0:22666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841aa0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22666:1875765325234304:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869885.103437:0:22666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841aa1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22666:1875765325234432:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869885.103478:0:22666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0aaf lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869885.105085:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869885.105147:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869885.113115:0:25698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305188864 00000100:00100000:2.0:1788869885.113142:0:25698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305188864 00010000:00010000:2.0:1788869885.113209:0:25698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0a93 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4bf expref: 36 pid: 22664 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869885.113265:0:25698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305188992 00000100:00100000:2.0:1788869885.113269:0:25698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305188992 00010000:00010000:2.0:1788869885.113284:0:25698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730200/0x4c16c38a9b6d09d6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca487 expref: 37 pid: 22666 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869885.113490:0:25698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1788869885.113503:0:25698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2825c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96d468b1-a138-4403-9587-850a7665da93+37:2410:x1875765305188864:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869885.113524:0:25698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869885.113531:0:25698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0a93 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4bf expref: 37 pid: 22664 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.113546:0:25698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0a93 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4bf expref: 37 pid: 22664 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.113573:0:25698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043400/0x4c16c38a9b6d0a93 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4bf expref: 37 pid: 22664 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.113620:0:25698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:2.0:1788869885.113626:0:25698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0aaf lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.113646:0:25698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0aaf lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.113653:0:25698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869885.113740:0:25698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2825c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96d468b1-a138-4403-9587-850a7665da93+36:2410:x1875765305188864:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 239us (8664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869885.113748:0:25698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 17 00000100:00100000:2.0:1788869885.113806:0:25698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 18 00000100:00100000:2.0:1788869885.113814:0:25698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96d468b1-a138-4403-9587-850a7665da93+35:2409:x1875765305188992:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869885.113832:0:25698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869885.113837:0:25698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730200/0x4c16c38a9b6d09d6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca487 expref: 35 pid: 22666 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.113847:0:25698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730200/0x4c16c38a9b6d09d6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca487 expref: 35 pid: 22666 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.113859:0:25698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730200/0x4c16c38a9b6d09d6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca487 expref: 35 pid: 22666 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.113871:0:25698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:2.0:1788869885.113874:0:25698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0aaf lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.113882:0:25698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0aaf lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.113891:0:25698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0aaf lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.113919:0:25698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869885.113940:0:25698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96d468b1-a138-4403-9587-850a7665da93+34:2409:x1875765305188992:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 128us (8794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869885.113946:0:25698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 18 00010000:00010000:0.0:1788869885.115226:0:22666:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0aaf lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.115244:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0aaf lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788869885.115269:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788869885.115431:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031000/0x4c16c38a9b6d0aa8 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4cd expref: 35 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.115450:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0aaf lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4cd expref: 34 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.115459:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:0.0:1788869885.115462:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788869885.115465:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2800030000, rc 0) 00000100:00100000:0.0:1788869885.115511:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e280138fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+34:18871:x1875765305188736:12345-192.168.204.54@tcp:101:bash.0 Request processed in 17616us (18026us total) trans 12884901912 rc 0/0 00000100:00100000:0.0:1788869885.115519:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 50 00000100:00100000:2.0:1788869885.123817:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869885.127124:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305189248 00000100:00100000:1.0:1788869885.127143:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305189248 00000100:00100000:1.0:1788869885.127241:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 51 00000100:00100000:1.0:1788869885.127252:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+34:18871:x1875765305189248:12345-192.168.204.54@tcp:36:bash.0 00010000:00010000:1.0:1788869885.127503:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043e00/0x4c16c38a9b6d0abd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.127523:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043e00/0x4c16c38a9b6d0abd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.127536:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043e00/0x4c16c38a9b6d0abd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869885.127630:0:22664:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:1.0:1788869885.127662:0:22664:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003c29869 reply state 0000000030a670fb transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043e00/0x4c16c38a9b6d0abd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.127674:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043e00/0x4c16c38a9b6d0abd lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.127681:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:1.0:1788869885.127684:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788869885.127689:0:22664:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788869885.127796:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+37:18871:x1875765305189248:12345-192.168.204.54@tcp:36:bash.0 Request processed in 545us (3989us total) trans 12884901914 rc 0/0 00000100:00100000:1.0:1788869885.127803:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 51 00000020:00080000:1.0:1788869885.127823:0:22664:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788869885.140743:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869885.140919:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305189376 00000100:00100000:1.0:1788869885.140932:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305189376 00000100:00100000:1.0:1788869885.141006:0:24506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:1.0:1788869885.141027:0:24506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+37:18871:x1875765305189376:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788869885.141052:0:24506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869885.141072:0:24506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0ac4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca4d4 expref: -99 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.141145:0:24506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0ac4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4d4 expref: 38 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.141163:0:24506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0ac4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4d4 expref: 38 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.141186:0:24506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:1.0:1788869885.141189:0:24506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869885.141193:0:24506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842042a00, rc 0) 00000100:00100000:1.0:1788869885.141270:0:24506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+38:18871:x1875765305189376:12345-192.168.204.54@tcp:101:bash.0 Request processed in 254us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869885.141278:0:24506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 52 00000100:00100000:3.0:1788869885.158099:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869885.158313:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305189504 00000100:00100000:0.0:1788869885.158326:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305189504 00000100:00100000:0.0:1788869885.158392:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:0.0:1788869885.158402:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+38:18871:x1875765305189504:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788869885.158432:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869885.158454:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031000/0x4c16c38a9b6d0acb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca4db expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.158650:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0ad2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.158667:0:22666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0aaf lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4cd expref: 39 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.158676:0:22666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0ad2 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.158715:0:22666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0aaf lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4cd expref: 39 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.158730:0:22666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0aaf lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4cd expref: 39 pid: 22666 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869885.158745:0:22666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841aa0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22666:1875765325234560:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869885.158844:0:22666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2802aac900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869885.162952:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869885.163066:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305189632 00000100:00100000:1.0:1788869885.163077:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305189632 00010000:00010000:1.0:1788869885.163123:0:22650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0aaf lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4cd expref: 40 pid: 22666 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869885.163176:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 19 00000100:00100000:1.0:1788869885.163187:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96d468b1-a138-4403-9587-850a7665da93+40:2409:x1875765305189632:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788869885.163224:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869885.163232:0:22650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0aaf lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4cd expref: 40 pid: 22666 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.163249:0:22650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0aaf lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4cd expref: 40 pid: 22666 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.163276:0:22650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:1.0:1788869885.163282:0:22650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0ad2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.163293:0:22650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0ad2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.163302:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0ad2 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.163323:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869885.163396:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96d468b1-a138-4403-9587-850a7665da93+40:2409:x1875765305189632:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 211us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869885.163822:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 19 00010000:00010000:2.0:1788869885.164117:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030000/0x4c16c38a9b6d0aaf lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4cd expref: 39 pid: 22666 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869885.164135:0:22666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841aa0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22666:1875765325234560:192.168.204.54@tcp:104: 00010000:00010000:2.0:1788869885.164165:0:22666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0ad2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.164175:0:22666:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0ad2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.164182:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0ad2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869885.164236:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788869885.164241:0:22666:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869885.164260:0:22666:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0ad2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.164292:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031000/0x4c16c38a9b6d0acb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4db expref: 39 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.164307:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0ad2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4db expref: 38 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.164316:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:2.0:1788869885.164319:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869885.164321:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2800030800, rc 0) 00000100:00100000:2.0:1788869885.164371:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+38:18871:x1875765305189504:12345-192.168.204.54@tcp:101:bash.0 Request processed in 5970us (6284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869885.164379:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 53 00000100:00100000:2.0:1788869885.168032:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869885.168110:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305189888 00000100:00100000:3.0:1788869885.168148:0:22649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305189888 00000100:00100000:3.0:1788869885.168235:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:3.0:1788869885.168249:0:22649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96d468b1-a138-4403-9587-850a7665da93+38:18871:x1875765305189888:12345-192.168.204.54@tcp:103:bash.0 00010000:00010000:3.0:1788869885.168278:0:22649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788869885.168308:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0ac4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4d4 expref: 38 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.168334:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800030800/0x4c16c38a9b6d0ad2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4db expref: 37 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.168347:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:3.0:1788869885.168353:0:22649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788869885.168573:0:22649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96d468b1-a138-4403-9587-850a7665da93+36:18871:x1875765305189888:12345-192.168.204.54@tcp:103:bash.0 Request processed in 326us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869885.168630:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 3 00000100:00100000:0.0:1788869885.171956:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869885.172056:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305190016 00000100:00100000:2.0:1788869885.172066:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305190016 00000100:00100000:2.0:1788869885.172141:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:2.0:1788869885.172178:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+36:18871:x1875765305190016:12345-192.168.204.54@tcp:58:bash.0 00010000:00010000:2.0:1788869885.172299:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730400/0x4c16c38a9b6d0ad9 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.172320:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730400/0x4c16c38a9b6d0ad9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.172332:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730400/0x4c16c38a9b6d0ad9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869885.173939:0:23784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788869885.173975:0:23784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1788869885.175304:0:23784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1788869885.175518:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+36:18871:x1875765305190016:12345-192.168.204.54@tcp:58:bash.0 Request processed in 3345us (3565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869885.175531:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 54 00000100:00100000:2.0:1788869885.181430:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869885.181575:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305190144 00000100:00100000:0.0:1788869885.181642:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305190144 00000100:00100000:0.0:1788869885.181726:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 55 00000100:00100000:0.0:1788869885.181739:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96d468b1-a138-4403-9587-850a7665da93+36:18871:x1875765305190144:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788869885.181766:0:22665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869885.181788:0:22665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6d0ae0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca4e2 expref: -99 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.181878:0:22665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730400/0x4c16c38a9b6d0ad9 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.181890:0:22665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6d0ae0 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4e2 expref: 37 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.181912:0:22665:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730400/0x4c16c38a9b6d0ad9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.181926:0:22665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6d0ae0 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4e2 expref: 37 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.181941:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:0.0:1788869885.181944:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788869885.181947:0:22665:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6d0ae0 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4e2 expref: 37 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.181954:0:22665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2840ed8800, rc 0) 00000100:00100000:0.0:1788869885.182029:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96d468b1-a138-4403-9587-850a7665da93+37:18871:x1875765305190144:12345-192.168.204.54@tcp:101:bash.0 Request processed in 293us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869885.182036:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 55 00000040:00080000:2.0:1788869885.446790:0:22700:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788869885.446800:0:22700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788869885.446828:0:22700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788869885.446838:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788869885.446994:0:22700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2817953100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22700:1875765325234688:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788869885.447117:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2703a92300 going to sleep for 11 seconds 00000100:00100000:2.0:1788869885.455096:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869885.455264:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305190272 00000100:00100000:0.0:1788869885.455284:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305190272 00000100:00100000:0.0:1788869885.455364:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:0.0:1788869885.455376:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+38:18872:x1875765305190272:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788869885.455701:0:22666:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788869885.455850:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+38:18872:x1875765305190272:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 477us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869885.455858:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 56 00000100:00100000:1.0:1788869885.455971:0:22700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2817953100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22700:1875765325234688:192.168.204.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788869885.464236:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869885.464733:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305190400 00000100:00100000:2.0:1788869885.464744:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305190400 00000100:00100000:2.0:1788869885.464819:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:2.0:1788869885.464831:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+37:18872:x1875765305190400:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788869885.464943:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730e00/0x4c16c38a9b6d0ae7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.465483:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730e00/0x4c16c38a9b6d0ae7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.465501:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730e00/0x4c16c38a9b6d0ae7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.465562:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d0aee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.465570:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d0aee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.465618:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d0aee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.465807:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0af5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.465819:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0af5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.465826:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0af5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788869885.465884:0:23784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788869885.465889:0:23784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788869885.465906:0:23784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0af5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.465918:0:23784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730e00/0x4c16c38a9b6d0ae7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.465933:0:23784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730e00/0x4c16c38a9b6d0ae7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.465939:0:23784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730e00/0x4c16c38a9b6d0ae7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.465945:0:23784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e280a730e00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869885.465950:0:23784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730e00/0x4c16c38a9b6d0ae7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.466337:0:23784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730e00/0x4c16c38a9b6d0ae7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.466351:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2701ef7300) 00010000:00010000:2.0:1788869885.466354:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869885.466360:0:23784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730e00/0x4c16c38a9b6d0ae7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.466367:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730e00/0x4c16c38a9b6d0ae7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.466384:0:23784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d0aee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.466390:0:23784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d0aee lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.466473:0:23784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d0aee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.466480:0:23784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e280a730600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869885.466493:0:23784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d0aee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.466500:0:23784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d0aee lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.466509:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8e2803b9ba00) 00010000:00010000:2.0:1788869885.466511:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869885.466514:0:23784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d0aee lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.466521:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d0aee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.466537:0:23784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0af5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.466543:0:23784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0af5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.466549:0:23784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0af5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.466553:0:23784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e280a731c00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:2.0:1788869885.466556:0:23784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0af5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.466562:0:23784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0af5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.466569:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:2.0:1788869885.467088:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788869885.467102:0:23784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0af5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.467110:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0af5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869885.467316:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+37:18872:x1875765305190400:12345-192.168.204.54@tcp:34:lhsmtool_posix.0 Request processed in 2483us (3086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869885.467327:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 57 00000100:00100000:2.0:1788869885.482561:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869885.483290:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305190656 00000100:00100000:1.0:1788869885.483303:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305190656 00000100:00100000:1.0:1788869885.483382:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:1.0:1788869885.483406:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+37:18872:x1875765305190656:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869885.483432:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869885.483457:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0afc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca4e9 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.483644:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b03 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.483663:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b03 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.483677:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b03 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869885.483690:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788869885.483798:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b03 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.483807:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b03 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.483815:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b03 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.483823:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842042a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869885.483829:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b03 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.483838:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b03 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.483852:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:1.0:1788869885.483855:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788869885.483860:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b03 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.483878:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b03 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.483924:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0afc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4e9 expref: 39 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.483934:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e2701ef7300) 00010000:00010000:1.0:1788869885.483936:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869885.483940:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0afc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4e9 expref: 39 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.483949:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842042600, rc 0) 00000100:00100000:1.0:1788869885.484216:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+38:18872:x1875765305190656:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 822us (1668us total) trans 12884901915 rc 301/301 00000100:00100000:1.0:1788869885.484225:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 58 00000100:00100000:0.0:1788869885.495975:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869885.496085:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305190784 00000100:00100000:2.0:1788869885.496096:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305190784 00000100:00100000:2.0:1788869885.496171:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:2.0:1788869885.496184:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+38:18872:x1875765305190784:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788869885.496229:0:22666:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788869885.496377:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+38:18872:x1875765305190784:12345-192.168.204.54@tcp:53:lhsmtool_posix.0 Request processed in 196us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869885.496385:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 59 00000100:00100000:0.0:1788869885.502289:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869885.502637:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305191040 00000100:00100000:2.0:1788869885.502648:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305191040 00000100:00100000:2.0:1788869885.502723:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:2.0:1788869885.502735:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+38:18872:x1875765305191040:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869885.502757:0:23784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869885.502780:0:23784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0b11 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca4f0 expref: -99 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788869885.503214:0:23784:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:2.0:1788869885.503221:0:23784:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:2.0:1788869885.503971:0:23784:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:2.0:1788869885.504642:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d0b18 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.504670:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d0b18 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.504684:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d0b18 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.504759:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0b11 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4f0 expref: 41 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.504779:0:23784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d0b18 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4f0 expref: 40 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.504788:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8e2803b9ba00) 00010000:00010000:2.0:1788869885.504791:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788869885.504795:0:23784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e280a730600, rc 0) 00000100:00100000:2.0:1788869885.504859:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+40:18872:x1875765305191040:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 2127us (2580us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1788869885.504868:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 60 00000100:00100000:3.0:1788869885.516830:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869885.518276:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305191296 00000100:00100000:1.0:1788869885.518289:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305191296 00000100:00100000:1.0:1788869885.518368:0:24506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:1.0:1788869885.518381:0:24506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+40:18872:x1875765305191296:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788869885.518444:0:24506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788869885.518482:0:24506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730600/0x4c16c38a9b6d0b18 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4f0 expref: 40 pid: 23784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.518507:0:24506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8e2803b9ba00) 00010000:00010000:1.0:1788869885.518520:0:24506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788869885.518549:0:24506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b26 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.518652:0:24506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b26 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.518665:0:24506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b26 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.518683:0:24506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b2d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x1f12ea09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.518690:0:24506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b2d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1f12ea09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.518707:0:24506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b2d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1f12ea09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.518767:0:24506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b26 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.518774:0:24506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b26 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.518781:0:24506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b26 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.518787:0:24506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842042600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869885.518791:0:24506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b26 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.518800:0:24506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b26 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.518808:0:24506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8e270365c400) 00010000:00010000:1.0:1788869885.518819:0:24506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869885.518824:0:24506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b26 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.518830:0:24506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b26 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.518843:0:24506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b2d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1f12ea09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.518848:0:24506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b2d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1f12ea09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.518853:0:24506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b2d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1f12ea09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.518858:0:24506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842042a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869885.518860:0:24506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b2d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1f12ea09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.518866:0:24506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b2d lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1f12ea09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.518873:0:24506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x1f12ea09 (ffff8e2701ef7000) 00010000:00010000:1.0:1788869885.518875:0:24506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788869885.518878:0:24506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b2d lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x1f12ea09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.518883:0:24506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b2d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x1f12ea09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869885.518967:0:24506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+39:18872:x1875765305191296:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 589us (2151us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788869885.518981:0:24506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 61 00000100:00100000:0.0:1788869885.522903:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869885.523001:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305191424 00000100:00100000:2.0:1788869885.523012:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305191424 00000100:00100000:2.0:1788869885.523072:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:2.0:1788869885.523083:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96d468b1-a138-4403-9587-850a7665da93+39:18872:x1875765305191424:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869885.523104:0:22665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869885.523128:0:22665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0b34 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca4f7 expref: -99 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.523207:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730e00/0x4c16c38a9b6d0b3b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.523221:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730e00/0x4c16c38a9b6d0b3b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.523234:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730e00/0x4c16c38a9b6d0b3b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.523371:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0b34 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4f7 expref: 41 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.523389:0:22665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730e00/0x4c16c38a9b6d0b3b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4f7 expref: 40 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.523398:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8e2803b9bb00) 00010000:00010000:2.0:1788869885.523401:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788869885.523405:0:22665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e280a730e00, rc 0) 00000100:00100000:2.0:1788869885.523478:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96d468b1-a138-4403-9587-850a7665da93+40:18872:x1875765305191424:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 396us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869885.523485:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 62 00000100:00100000:0.0:1788869885.530239:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869885.530559:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305191680 00000100:00100000:2.0:1788869885.530584:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305191680 00000100:00100000:2.0:1788869885.530685:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:2.0:1788869885.530773:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+40:18872:x1875765305191680:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788869885.530879:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731600/0x4c16c38a9b6d0b42 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.530921:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731600/0x4c16c38a9b6d0b42 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.530933:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731600/0x4c16c38a9b6d0b42 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788869885.531130:0:23784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:2.0:1788869885.531141:0:23784:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 819444553502ns, next at 820444550642ns, rc = 0 00000004:00010000:2.0:1788869885.531196:0:23784:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ff78780 reply state 00000000227490f8 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731600/0x4c16c38a9b6d0b42 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.531211:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731600/0x4c16c38a9b6d0b42 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.531220:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8e2803b9bb00) 00010000:00010000:2.0:1788869885.531223:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788869885.531228:0:23784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788869885.531352:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+42:18872:x1875765305191680:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 656us (1126us total) trans 12884901917 rc 0/0 00000100:00100000:2.0:1788869885.531360:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 63 00000100:00100000:3.0:1788869885.541508:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869885.541683:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305191808 00000100:00100000:2.0:1788869885.541694:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305191808 00000100:00100000:2.0:1788869885.542518:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:2.0:1788869885.542531:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f058e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+42:18872:x1875765305191808:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788869885.542564:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788869885.542659:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0b49 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca4fe expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.544421:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0b49 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4fe expref: 43 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.544445:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0b49 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4fe expref: 43 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.544472:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8e2803b9bb00) 00010000:00010000:1.0:1788869885.544476:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869885.544480:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e280a731c00, rc 0) 00000100:00100000:1.0:1788869885.544659:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f058e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+43:18872:x1875765305191808:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 2130us (3163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869885.544669:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 64 00000100:00100000:0.0:1788869885.557884:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869885.562187:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305191936 00000100:00100000:1.0:1788869885.562204:0:24175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305191936 00000100:00100000:1.0:1788869885.562312:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:1.0:1788869885.562328:0:24175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96d468b1-a138-4403-9587-850a7665da93+5:2409:x1875765305191936:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788869885.562717:0:24175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96d468b1-a138-4403-9587-850a7665da93+6:2409:x1875765305191936:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 393us (4843us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1788869885.562725:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00080000:0.0:1788869885.562920:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869885.572544:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869885.572816:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305192192 00000100:00100000:1.0:1788869885.572827:0:22668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305192192 00000100:00100000:1.0:1788869885.574487:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:1.0:1788869885.574514:0:22668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96d468b1-a138-4403-9587-850a7665da93+43:18872:x1875765305192192:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788869885.574838:0:22668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96d468b1-a138-4403-9587-850a7665da93+44:18872:x1875765305192192:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 337us (2303us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1788869885.574862:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 11 00000100:00100000:0.0:1788869885.585117:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869885.585243:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305192448 00000100:00100000:1.0:1788869885.585257:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305192448 00000100:00100000:1.0:1788869885.585413:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:1.0:1788869885.585425:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+44:18872:x1875765305192448:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788869885.585556:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+44:18872:x1875765305192448:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 133us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869885.585565:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 65 00000100:00100000:2.0:1788869885.589732:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869885.589925:0:24506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305192576 00000100:00100000:1.0:1788869885.589936:0:24506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305192576 00000100:00100000:1.0:1788869885.590004:0:24506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:1.0:1788869885.590015:0:24506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+44:18872:x1875765305192576:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869885.590037:0:24506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869885.590059:0:24506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b50 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca505 expref: -99 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.590141:0:24506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b57 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.590169:0:24506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b57 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.590181:0:24506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b57 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869885.590230:0:24506:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788869885.590249:0:24506:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b57 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.590310:0:24506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0b50 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca505 expref: 46 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.590331:0:24506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b57 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca505 expref: 45 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.590339:0:24506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8e2803b9bb00) 00010000:00010000:1.0:1788869885.590342:0:24506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788869885.590347:0:24506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842042600, rc 0) 00000100:00100000:1.0:1788869885.590656:0:24506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96d468b1-a138-4403-9587-850a7665da93+45:18872:x1875765305192576:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 642us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869885.590664:0:24506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 66 00000100:00100000:2.0:1788869885.599021:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869885.599185:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305192704 00000100:00100000:1.0:1788869885.599198:0:24176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305192704 00000100:00100000:1.0:1788869885.599285:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:1.0:1788869885.599296:0:24176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96d468b1-a138-4403-9587-850a7665da93+6:2410:x1875765305192704:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788869885.599316:0:24176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869885.599339:0:24176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d90752c/0x4c16c38a9b6d0b5e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca50c expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788869885.599373:0:24176:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ffcfc, blocks: 0x0 00010000:00010000:1.0:1788869885.599402:0:24176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=819s v=(0 0) 00010000:00010000:1.0:1788869885.599407:0:24176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788869885.599418:0:24176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d90752c/0x4c16c38a9b6d0b5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca50c expref: 7 pid: 24176 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.599468:0:24176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007d90752c/0x4c16c38a9b6d0b5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca50c expref: 7 pid: 24176 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.599485:0:24176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842042a00, rc 0) 00000100:00100000:1.0:1788869885.599556:0:24176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96d468b1-a138-4403-9587-850a7665da93+7:2410:x1875765305192704:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 262us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869885.599564:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:2.0:1788869885.603633:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869885.603863:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305192960 00000100:00100000:1.0:1788869885.603874:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305192960 00000100:00100000:1.0:1788869885.603951:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:1.0:1788869885.603962:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+45:18872:x1875765305192960:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788869885.604097:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+45:18872:x1875765305192960:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 136us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869885.604105:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 67 00000100:00100000:2.0:1788869885.619103:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869885.620923:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305193088 00000100:00100000:1.0:1788869885.620940:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305193088 00000100:00100000:1.0:1788869885.621026:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 68 00000100:00100000:1.0:1788869885.621038:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+45:18872:x1875765305193088:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788869885.638173:0:22644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:2.0:1788869885.638192:0:22644:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788869885.638264:0:22644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:1.0:1788869885.640985:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0974 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.641004:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0974 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.641012:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0974 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.641027:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869885.641032:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0974 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.641039:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0974 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.641057:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8e270365c400) 00010000:00010000:1.0:1788869885.641060:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788869885.641066:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0974 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.641073:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0974 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869885.641229:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+20:18872:x1875765305193088:12345-192.168.204.54@tcp:44:lhsmtool_posix.0 Request processed in 20187us (22138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869885.641240:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 68 00010000:00010000:0.0:1788869885.641833:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0920 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.641844:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0920 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.641851:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0920 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.641857:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869885.641860:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0920 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.641867:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0920 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.641880:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8e2803b9b500) 00010000:00010000:0.0:1788869885.641883:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869885.641888:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0920 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.641905:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0920 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.641927:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6d0927 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.641934:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6d0927 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.641940:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6d0927 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.641945:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869885.641948:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6d0927 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.641955:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6d0927 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.641963:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8e270365c400) 00010000:00010000:0.0:1788869885.641966:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869885.641969:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6d0927 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.641976:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f400/0x4c16c38a9b6d0927 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.641990:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09cf lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.641997:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09cf lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642010:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09cf lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642016:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e280a730a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869885.642019:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09cf lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642026:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09cf lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642035:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8e2803b9bf00) 00010000:00010000:0.0:1788869885.642037:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869885.642040:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09cf lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642045:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730a00/0x4c16c38a9b6d09cf lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642062:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a54 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642069:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a54 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642075:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a54 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642081:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840edac00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869885.642083:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a54 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642102:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a54 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642110:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:0.0:1788869885.642113:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869885.642116:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a54 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642121:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840edac00/0x4c16c38a9b6d0a54 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642136:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0a77 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642141:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0a77 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642146:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0a77 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642150:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2800031800 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869885.642153:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0a77 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642157:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0a77 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642164:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:0.0:1788869885.642166:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869885.642169:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0a77 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642184:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2800031800/0x4c16c38a9b6d0a77 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642199:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043e00/0x4c16c38a9b6d0abd lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642205:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043e00/0x4c16c38a9b6d0abd lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642210:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043e00/0x4c16c38a9b6d0abd lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642215:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842043e00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869885.642218:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043e00/0x4c16c38a9b6d0abd lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642224:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043e00/0x4c16c38a9b6d0abd lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642232:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:0.0:1788869885.642234:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869885.642237:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043e00/0x4c16c38a9b6d0abd lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642242:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842043e00/0x4c16c38a9b6d0abd lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642254:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731600/0x4c16c38a9b6d0b42 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642260:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731600/0x4c16c38a9b6d0b42 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642272:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731600/0x4c16c38a9b6d0b42 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642276:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e280a731600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869885.642279:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731600/0x4c16c38a9b6d0b42 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642286:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731600/0x4c16c38a9b6d0b42 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642294:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8e2803b9bb00) 00010000:00010000:0.0:1788869885.642297:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788869885.642300:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731600/0x4c16c38a9b6d0b42 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.642305:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731600/0x4c16c38a9b6d0b42 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869885.642327:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788869885.642345:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702a62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325234816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788869885.642413:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869885.643373:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325234816 00000100:00100000:1.0:1788869885.643387:0:24175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325234816 00000100:00100000:1.0:1788869885.643462:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788869885.643473:0:24175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27039f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325234816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788869885.643672:0:24175:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788869885.643677:0:24175:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788869885.643679:0:24175:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788869885.643681:0:24175:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788869884 -> 1788869884 00002000:00010000:1.0:1788869885.643683:0:24175:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788869885.643756:0:24175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27039f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875765325234816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 286us (1342us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788869885.643776:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:2.0:1788869885.644173:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e2702a62680/2, rc 0, transno 12884901892 00000100:00100000:2.0:1788869885.644181:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702a62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325234816:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1788869885.644292:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788869885.654447:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869885.654647:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305193216 00000100:00100000:1.0:1788869885.654672:0:24176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305193216 00000100:00100000:1.0:1788869885.654751:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:1.0:1788869885.654765:0:24176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96d468b1-a138-4403-9587-850a7665da93+7:2409:x1875765305193216:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788869885.657891:0:24176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96d468b1-a138-4403-9587-850a7665da93+7:2409:x1875765305193216:12345-192.168.204.54@tcp:16:lhsmtool_posix.0 Request processed in 3114us (3439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869885.657910:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 28 00000100:00100000:1.0:1788869885.664487:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869885.665019:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305193472 00000100:00100000:0.0:1788869885.665033:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305193472 00000100:00100000:0.0:1788869885.665113:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:0.0:1788869885.665126:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96d468b1-a138-4403-9587-850a7665da93+14:18872:x1875765305193472:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788869885.665192:0:22665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869885.665222:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b57 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca505 expref: 14 pid: 24506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.665264:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8e2803b9bb00) 00010000:00010000:0.0:1788869885.665270:0:22665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788869885.665321:0:22665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6d0b65 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.665337:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6d0b65 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.665348:0:22665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6d0b65 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869885.665501:0:22665:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aca6e60e reply state 000000002e796876 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6d0b65 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.665514:0:22665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8200/0x4c16c38a9b6d0b65 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.665520:0:22665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8e2803b9bb00) 00010000:00010000:0.0:1788869885.665523:0:22665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788869885.665525:0:22665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788869885.666951:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96d468b1-a138-4403-9587-850a7665da93+15:18872:x1875765305193472:12345-192.168.204.54@tcp:36:lhsmtool_posix.0 Request processed in 1817us (2481us total) trans 12884901919 rc 0/0 00000100:00100000:0.0:1788869885.666966:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 69 00000100:00100000:2.0:1788869885.674193:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869885.677021:0:24175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305193600 00000100:00100000:1.0:1788869885.677121:0:24175:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305193600 00000100:00100000:1.0:1788869885.677216:0:24175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:0.0:1788869885.678141:0:24175:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96d468b1-a138-4403-9587-850a7665da93+7:18872:x1875765305193600:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788869885.678165:0:24175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869885.678190:0:24175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d0b6c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca513 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.678251:0:24175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007d90752c/0x4c16c38a9b6d0b5e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca50c expref: 8 pid: 24176 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.678261:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869885.678266:0:24175:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869885.678272:0:24175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d0b6c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca513 expref: 8 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.678323:0:24175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007d90752c/0x4c16c38a9b6d0b5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca50c expref: 8 pid: 24176 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.678341:0:24175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007d90752c/0x4c16c38a9b6d0b5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca50c expref: 8 pid: 24176 timeout: 919 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869885.678357:0:24175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702928e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24175:1875765325234944:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869885.678471:0:24175:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28098a1180 going to sleep for 11 seconds 00000100:00100000:2.0:1788869885.685139:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869885.685576:0:25698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305193728 00000100:00100000:3.0:1788869885.685612:0:25698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305193728 00010000:00010000:3.0:1788869885.685661:0:25698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007d90752c/0x4c16c38a9b6d0b5e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca50c expref: 9 pid: 24176 timeout: 919 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869885.685706:0:25698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:3.0:1788869885.685715:0:25698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817953480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96d468b1-a138-4403-9587-850a7665da93+9:2410:x1875765305193728:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788869885.685731:0:25698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788869885.685755:0:25698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007d90752c/0x4c16c38a9b6d0b5e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca50c expref: 9 pid: 24176 timeout: 919 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.685785:0:25698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007d90752c/0x4c16c38a9b6d0b5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca50c expref: 9 pid: 24176 timeout: 919 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.685814:0:25698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869885.685819:0:25698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869885.685826:0:25698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d0b6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca513 expref: 9 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.685836:0:25698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d0b6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca513 expref: 9 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.685886:0:25698:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d0b6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca513 expref: 9 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869885.685902:0:25698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f059180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:25698:1875765325235072:192.168.204.54@tcp:105: 00000100:00100000:3.0:1788869885.686030:0:25698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280b039e40 going to sleep for 11 seconds 00010000:00010000:0.0:1788869885.687073:0:24175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d90752c/0x4c16c38a9b6d0b5e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca50c expref: 9 pid: 24176 timeout: 919 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869885.687102:0:24175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702928e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24175:1875765325234944:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869885.687141:0:24175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d0b6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca513 expref: 8 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.687178:0:24175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6400, rc 0) 00000100:00100000:0.0:1788869885.687248:0:24175:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96d468b1-a138-4403-9587-850a7665da93+8:18872:x1875765305193600:12345-192.168.204.54@tcp:101:lhsmtool_posix.0 Request processed in 9789us (13065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869885.687259:0:24175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 29 00000100:00100000:3.0:1788869885.706267:0:25698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f059180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:25698:1875765325235072:192.168.204.54@tcp:105: 00010000:00010000:3.0:1788869885.706303:0:25698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788869885.706703:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869885.708643:0:24507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305193856 00000100:00100000:3.0:1788869885.708664:0:24507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305193856 00000100:00100000:3.0:1788869885.708736:0:24507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:3.0:1788869885.708748:0:24507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2702a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96d468b1-a138-4403-9587-850a7665da93+8:2410:x1875765305193856:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788869885.709260:0:24507:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788869885.709282:0:24507:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788869884 00002000:00010000:3.0:1788869885.709285:0:24507:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788869882 00002000:00010000:3.0:1788869885.709287:0:24507:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788869884 -> 1788869884 00002000:00010000:3.0:1788869885.709289:0:24507:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788869885.709444:0:24507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2702a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96d468b1-a138-4403-9587-850a7665da93+9:2410:x1875765305193856:12345-192.168.204.54@tcp:2:lhsmtool_posix.0 Request processed in 697us (2743us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788869885.709454:0:24507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 30 00000100:00100000:2.0:1788869885.709642:0:25698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817953480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96d468b1-a138-4403-9587-850a7665da93+8:2410:x1875765305193728:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 23926us (24519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869885.709653:0:25698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 20 00000100:00100000:2.0:1788869885.718792:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869885.718897:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305193984 00000100:00100000:3.0:1788869885.718908:0:24174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305193984 00000100:00100000:3.0:1788869885.719013:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:3.0:1788869885.719023:0:24174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96d468b1-a138-4403-9587-850a7665da93+8:2410:x1875765305193984:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788869885.719069:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000520ad1b2/0x4c16c38a9b6d0b73 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.719089:0:24174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d0b6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca513 expref: 8 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.719099:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788869885.719103:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788869885.719108:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000520ad1b2/0x4c16c38a9b6d0b73 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.719142:0:24174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d0b6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca513 expref: 8 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.719156:0:24174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d0b6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca513 expref: 8 pid: 24175 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869885.719191:0:24174:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f059180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24174:1875765325235200:192.168.204.54@tcp:104: 00000100:00100000:3.0:1788869885.719276:0:24174:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e280b039e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788869885.725492:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869885.725711:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305194112 00000100:00100000:2.0:1788869885.725723:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305194112 00010000:00010000:2.0:1788869885.725771:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d0b6c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca513 expref: 9 pid: 24175 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869885.725815:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 21 00000100:00100000:2.0:1788869885.725827:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841003480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96d468b1-a138-4403-9587-850a7665da93+9:2410:x1875765305194112:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869885.725858:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869885.725900:0:22651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d0b6c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca513 expref: 9 pid: 24175 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.725938:0:22651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d0b6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca513 expref: 9 pid: 24175 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.726049:0:22651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869885.726055:0:22651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788869885.726061:0:22651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000520ad1b2/0x4c16c38a9b6d0b73 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.726073:0:22651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000520ad1b2/0x4c16c38a9b6d0b73 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.726099:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869885.726164:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841003480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96d468b1-a138-4403-9587-850a7665da93+9:2410:x1875765305194112:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 339us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869885.726171:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 21 00010000:00010000:3.0:1788869885.726810:0:24174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002afe8117/0x4c16c38a9b6d0b6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca513 expref: 8 pid: 24175 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869885.726902:0:24174:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f059180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24174:1875765325235200:192.168.204.54@tcp:104: 00010000:00010000:3.0:1788869885.726927:0:24174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000520ad1b2/0x4c16c38a9b6d0b73 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.726939:0:24174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000520ad1b2/0x4c16c38a9b6d0b73 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.727054:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000520ad1b2/0x4c16c38a9b6d0b73 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.727082:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000520ad1b2/0x4c16c38a9b6d0b73 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.727091:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000520ad1b2/0x4c16c38a9b6d0b73 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.727099:0:24174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000520ad1b2/0x4c16c38a9b6d0b73 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.727122:0:24174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:3.0:1788869885.727128:0:24174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000520ad1b2/0x4c16c38a9b6d0b73 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.727138:0:24174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000520ad1b2/0x4c16c38a9b6d0b73 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.727154:0:24174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000520ad1b2/0x4c16c38a9b6d0b73 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.727163:0:24174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000520ad1b2/0x4c16c38a9b6d0b73 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788869885.728099:0:24174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96d468b1-a138-4403-9587-850a7665da93+7:2410:x1875765305193984:12345-192.168.204.54@tcp:1:lhsmtool_posix.0 Request processed in 9065us (9307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869885.728111:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 31 00000100:00100000:1.0:1788869885.743443:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869885.748522:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305194368 00000100:00100000:0.0:1788869885.748540:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305194368 00000100:00100000:0.0:1788869885.748657:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 70 00000100:00100000:0.0:1788869885.748670:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+15:18872:x1875765305194368:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788869885.748768:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0b7a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.748786:0:23784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731000/0x4c16c38a9b6d0a4d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4b1 expref: 15 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.748795:0:23784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0b7a lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.748833:0:23784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731000/0x4c16c38a9b6d0a4d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4b1 expref: 15 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.748863:0:23784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731000/0x4c16c38a9b6d0a4d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4b1 expref: 15 pid: 22666 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869885.748881:0:23784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702928e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23784:1875765325235328:192.168.204.54@tcp:104: 00000100:00100000:0.0:1788869885.749202:0:23784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e28098a1180 going to sleep for 11 seconds 00000100:00100000:0.0:1788869885.752038:0:23784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702928e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23784:1875765325235328:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869885.752071:0:23784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0b7a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869885.755441:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869885.755791:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305194496 00000100:00100000:0.0:1788869885.755806:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305194496 00010000:00010000:0.0:1788869885.755881:0:22650:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731000/0x4c16c38a9b6d0a4d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4b1 expref: 16 pid: 22666 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869885.755945:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 22 00000100:00100000:0.0:1788869885.755958:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96d468b1-a138-4403-9587-850a7665da93+16:2409:x1875765305194496:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788869885.755977:0:22650:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788869885.755985:0:22650:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731000/0x4c16c38a9b6d0a4d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4b1 expref: 16 pid: 22666 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.756000:0:22650:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731000/0x4c16c38a9b6d0a4d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4b1 expref: 16 pid: 22666 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.756028:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731000/0x4c16c38a9b6d0a4d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4b1 expref: 16 pid: 22666 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.756047:0:22650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:0.0:1788869885.756054:0:22650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6d0ae0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4e2 expref: 15 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.756065:0:22650:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0b7a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.756094:0:22650:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0b7a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.756103:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0b7a lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.756140:0:22650:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788869885.756210:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96d468b1-a138-4403-9587-850a7665da93+15:2409:x1875765305194496:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 253us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869885.756218:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 22 00010000:00010000:1.0:1788869885.756642:0:23784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0b7a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.756652:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0b7a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.756938:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b81 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.756957:0:23784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0b49 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4fe expref: 15 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.756981:0:23784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b81 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.757023:0:23784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0b49 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4fe expref: 15 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.757043:0:23784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0b49 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4fe expref: 15 pid: 22666 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869885.757066:0:23784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841fc5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23784:1875765325235456:192.168.204.54@tcp:104: 00000100:00100000:1.0:1788869885.757171:0:23784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2801370e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788869885.763382:0:23784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841fc5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23784:1875765325235456:192.168.204.54@tcp:104: 00010000:00010000:0.0:1788869885.763420:0:23784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b81 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869885.764584:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869885.764720:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305194624 00000100:00100000:2.0:1788869885.764733:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305194624 00010000:00010000:2.0:1788869885.764780:0:22651:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0b49 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4fe expref: 16 pid: 22666 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788869885.764816:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 23 00000100:00100000:2.0:1788869885.764826:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2825c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96d468b1-a138-4403-9587-850a7665da93+16:2408:x1875765305194624:12345-192.168.204.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788869885.764863:0:22651:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788869885.764871:0:22651:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0b49 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4fe expref: 16 pid: 22666 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.764916:0:22651:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0b49 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4fe expref: 16 pid: 22666 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.764943:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a731c00/0x4c16c38a9b6d0b49 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4fe expref: 16 pid: 22666 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.764959:0:22651:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8e2803b9bb00) 00010000:00010000:2.0:1788869885.764964:0:22651:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b81 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.764974:0:22651:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b81 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.764982:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b81 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.765014:0:22651:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788869885.765074:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2825c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96d468b1-a138-4403-9587-850a7665da93+15:2408:x1875765305194624:12345-192.168.204.54@tcp:103:ldlm_bl.0 Request processed in 249us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869885.765082:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 23 00010000:00010000:1.0:1788869885.765630:0:23784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b81 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.765641:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b81 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788869885.765776:0:23784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:1.0:1788869885.765927:0:23784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:1.0:1788869885.765966:0:23784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:1.0:1788869885.766056:0:23784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841fc4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:23784:1875765325235584:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788869885.766117:0:23784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869885.766147:0:23784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2840f55900 going to sleep for 11 seconds 00000100:00100000:0.0:1788869885.766331:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325235584 00000100:00100000:0.0:1788869885.766339:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325235584 00000100:00100000:0.0:1788869885.766397:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788869885.766405:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23784:x1875765325235584:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788869885.766507:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23784:x1875765325235584:12345-0@lo:1000:mdt00_003.0 Request processed in 103us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869885.766515:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788869885.767400:0:23784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841fc4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:23784:1875765325235584:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788869885.767683:0:23784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:1.0:1788869885.767776:0:23784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841fc4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:23784:1875765325235712:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788869885.769020:0:23784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869885.769070:0:23784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2808840600 going to sleep for 11 seconds 00000100:00100000:2.0:1788869885.769468:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325235712 00000100:00100000:2.0:1788869885.769480:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325235712 00000100:00100000:2.0:1788869885.769561:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788869885.769581:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841fc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23784:x1875765325235712:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788869885.770066:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841fc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:23784:x1875765325235712:12345-0@lo:1000:mdt00_003.0 Request processed in 260us (825us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1788869885.770074:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788869885.770360:0:23784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841fc4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:23784:1875765325235712:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788869885.770416:0:23784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b81 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.770427:0:23784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b81 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.770435:0:23784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b81 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.770443:0:23784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2842042600 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869885.770448:0:23784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b81 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.770456:0:23784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b81 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.770475:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8e2803b9bb00) 00010000:00010000:1.0:1788869885.770478:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869885.770484:0:23784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b81 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.770490:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b81 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.770529:0:23784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730400/0x4c16c38a9b6d0ad9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.770535:0:23784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730400/0x4c16c38a9b6d0ad9 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.770548:0:23784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730400/0x4c16c38a9b6d0ad9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.770577:0:23784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e280a730400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:1.0:1788869885.770581:0:23784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730400/0x4c16c38a9b6d0ad9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.770613:0:23784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730400/0x4c16c38a9b6d0ad9 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.770622:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:1.0:1788869885.770625:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788869885.770632:0:23784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6d0ae0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4e2 expref: 18 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.770646:0:23784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6d0ae0 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4e2 expref: 18 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.770656:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6d0ae0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4e2 expref: 18 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.770691:0:23784:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840ed8800/0x4c16c38a9b6d0ae0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca4e2 expref: 18 pid: 22665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788869885.770705:0:23784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841fc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23784:1875765325235840:192.168.204.54@tcp:105: 00000100:00100000:1.0:1788869885.770782:0:23784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e2808840600 going to sleep for 11 seconds 00000100:00100000:1.0:1788869885.779500:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869885.779933:0:23784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841fc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23784:1875765325235840:192.168.204.54@tcp:105: 00010000:00010000:0.0:1788869885.779973:0:23784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730400/0x4c16c38a9b6d0ad9 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.779985:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e280a730400/0x4c16c38a9b6d0ad9 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.780042:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0b88 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.780058:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0b88 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.780071:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0b88 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.780082:0:23784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0b88 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.780088:0:23784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0b88 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.780095:0:23784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0b88 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.780100:0:23784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869885.780105:0:23784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0b88 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.780111:0:23784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0b88 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.780122:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:0.0:1788869885.780125:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869885.780129:0:23784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0b88 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.780133:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0b88 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.780166:0:23784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0b7a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.780172:0:23784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0b7a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.780177:0:23784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0b7a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.780182:0:23784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6a00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869885.780186:0:23784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0b7a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.780191:0:23784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0b7a lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.780198:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:0.0:1788869885.780201:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788869885.780204:0:23784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0b7a lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.780212:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6a00/0x4c16c38a9b6d0b7a lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869885.780411:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+18:18872:x1875765305194368:12345-192.168.204.54@tcp:57:lhsmtool_posix.0 Request processed in 31743us (36985us total) trans 12884901924 rc 0/0 00000100:00100000:0.0:1788869885.780422:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 70 00000020:00080000:0.0:1788869885.780430:0:23784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788869885.781219:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305194752 00000100:00100000:3.0:1788869885.781230:0:22667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305194752 00000100:00100000:3.0:1788869885.781280:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 12 00000100:00100000:3.0:1788869885.781290:0:22667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841fc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96d468b1-a138-4403-9587-850a7665da93+18:18871:x1875765305194752:12345-192.168.204.54@tcp:49:bash.0 00000100:00100000:3.0:1788869885.781464:0:22667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841fc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96d468b1-a138-4403-9587-850a7665da93+18:18871:x1875765305194752:12345-192.168.204.54@tcp:49:bash.0 Request processed in 175us (1976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869885.781471:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 12 00000040:00080000:1.0:1788869885.783508:0:22700:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788869885.783530:0:22700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869885.783576:0:22700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788869885.783614:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788869885.790222:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869885.790523:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305195008 00000100:00100000:3.0:1788869885.790579:0:22667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305195008 00000100:00100000:3.0:1788869885.790688:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 13 00000100:00100000:3.0:1788869885.790698:0:22667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96d468b1-a138-4403-9587-850a7665da93+18:18872:x1875765305195008:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788869885.791083:0:22667:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788869885.791129:0:22667:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:3.0:1788869885.791174:0:22667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f600/0x4c16c38a9b6d0b8f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.791195:0:22667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f600/0x4c16c38a9b6d0b8f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.791208:0:22667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f600/0x4c16c38a9b6d0b8f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.791217:0:22667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f600/0x4c16c38a9b6d0b8f lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.791222:0:22667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f600/0x4c16c38a9b6d0b8f lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.791228:0:22667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f600/0x4c16c38a9b6d0b8f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788869885.791244:0:22667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788869885.791357:0:22667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96d468b1-a138-4403-9587-850a7665da93+20:18872:x1875765305195008:12345-192.168.204.54@tcp:35:lhsmtool_posix.0 Request processed in 658us (1149us total) trans 12884901926 rc 0/0 00000100:00100000:3.0:1788869885.791366:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 13 00000020:00080000:3.0:1788869885.791373:0:22667:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788869885.792190:0:25255:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788869885.792201:0:25255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f600/0x4c16c38a9b6d0b8f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.792210:0:25255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e2840c7f600 already unused, calling callback (ffffffffc0d1d8b0) 00010000:00010000:2.0:1788869885.792215:0:25255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f600/0x4c16c38a9b6d0b8f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.792224:0:25255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f600/0x4c16c38a9b6d0b8f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.792240:0:25255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8e2803b9bb00) 00010000:00010000:2.0:1788869885.792243:0:25255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788869885.792249:0:25255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f600/0x4c16c38a9b6d0b8f lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.792255:0:25255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2840c7f600/0x4c16c38a9b6d0b8f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788869885.792273:0:25255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869885.792274:0:25255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788869885.792276:0:25255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788869885.797179:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869885.797284:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305195136 00000100:00100000:0.0:1788869885.797295:0:24176:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305195136 00000100:00100000:0.0:1788869885.797381:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:0.0:1788869885.797394:0:24176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841fc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96d468b1-a138-4403-9587-850a7665da93+7:18871:x1875765305195136:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:0.0:1788869885.797417:0:24176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788869885.797441:0:24176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d0b96 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca51a expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788869885.797480:0:24176:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9ffcfc, atime: 0x6a9ffcfa, ctime: 0x6a9ffcfc, blocks: 0x0 00010000:00010000:0.0:1788869885.797508:0:24176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=819s v=(0 0) 00010000:00010000:0.0:1788869885.797514:0:24176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788869885.797525:0:24176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d0b96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca51a expref: 8 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.797543:0:24176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004d965fa9/0x4c16c38a9b6d0b96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca51a expref: 8 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.797576:0:24176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e28029d6a00, rc 0) 00000100:00100000:0.0:1788869885.797679:0:24176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841fc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96d468b1-a138-4403-9587-850a7665da93+8:18871:x1875765305195136:12345-192.168.204.54@tcp:101:bash.0 Request processed in 288us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869885.797687:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 32 00000100:00100000:2.0:1788869885.801708:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869885.801822:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305195264 00000100:00100000:1.0:1788869885.801851:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305195264 00000100:00100000:1.0:1788869885.801927:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:1.0:1788869885.801941:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+20:18871:x1875765305195264:12345-192.168.204.54@tcp:101:bash.0 00010000:00010000:1.0:1788869885.801981:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869885.802007:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b9d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca521 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.802054:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0ba4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.802070:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0ba4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.802084:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0ba4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.802226:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0b9d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca521 expref: 22 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.802248:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042a00/0x4c16c38a9b6d0ba4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca521 expref: 21 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.802256:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:1.0:1788869885.802259:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788869885.802270:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842042a00, rc 0) 00000100:00100000:1.0:1788869885.802344:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96d468b1-a138-4403-9587-850a7665da93+21:18871:x1875765305195264:12345-192.168.204.54@tcp:101:bash.0 Request processed in 407us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869885.802353:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 71 00000100:00100000:2.0:1788869885.816276:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869885.816368:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305195520 00000100:00100000:3.0:1788869885.816380:0:22667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305195520 00000100:00100000:3.0:1788869885.816447:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 14 00000100:00100000:3.0:1788869885.816471:0:22667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96d468b1-a138-4403-9587-850a7665da93+21:18871:x1875765305195520:12345-192.168.204.54@tcp:35:bash.0 00000001:00080000:3.0:1788869885.816833:0:22667:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000100:00100000:3.0:1788869885.817466:0:22667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96d468b1-a138-4403-9587-850a7665da93+23:18871:x1875765305195520:12345-192.168.204.54@tcp:35:bash.0 Request processed in 992us (1198us total) trans 12884901928 rc 0/0 00000100:00100000:3.0:1788869885.817476:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 14 00000020:00080000:3.0:1788869885.817482:0:22667:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788869885.893896:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869885.922583:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:1.0:1788869885.922743:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305195776 00000100:00100000:1.0:1788869885.922755:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305195776 00000100:00100000:1.0:1788869885.922833:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:1.0:1788869885.922843:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+23:18882:x1875765305195776:12345-192.168.204.54@tcp:101:lfs.0 00010000:00010000:1.0:1788869885.922870:0:22666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788869885.922893:0:22666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0bab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc3e012f36fca528 expref: -99 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788869885.923005:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788869885.923123:0:22666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0bab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca528 expref: 25 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.923154:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e2701ef7700) 00010000:00010000:1.0:1788869885.923158:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788869885.923163:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e2842042600/0x4c16c38a9b6d0bab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.54@tcp remote: 0xdc3e012f36fca528 expref: 25 pid: 22666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788869885.923180:0:22666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e2842042600, rc 0) 00000100:00100000:1.0:1788869885.923256:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96d468b1-a138-4403-9587-850a7665da93+24:18882:x1875765305195776:12345-192.168.204.54@tcp:101:lfs.0 Request processed in 414us (695us total) trans 12884901929 rc 301/301 00000100:00100000:1.0:1788869885.923265:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 72 00000100:00100000:2.0:1788869885.928696:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869885.928803:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305195904 00000100:00100000:0.0:1788869885.928813:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305195904 00000100:00100000:0.0:1788869885.928888:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:0.0:1788869885.928900:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+24:18882:x1875765305195904:12345-192.168.204.54@tcp:34:lfs.0 00010000:00010000:0.0:1788869885.928993:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0bb9 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929012:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0bb9 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929036:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0bb9 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929055:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0bc0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929063:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0bc0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929069:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0bc0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929221:0:23784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6d0bc7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929231:0:23784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6d0bc7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929238:0:23784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6d0bc7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788869885.929284:0:23784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6d0bc7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929297:0:23784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0bb9 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929304:0:23784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0bb9 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929310:0:23784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0bb9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929326:0:23784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e28029d6400 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869885.929330:0:23784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0bb9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929337:0:23784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0bb9 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929349:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8e270365c400) 00010000:00010000:0.0:1788869885.929351:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869885.929356:0:23784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0bb9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929362:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e28029d6400/0x4c16c38a9b6d0bb9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929374:0:23784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0bc0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929379:0:23784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0bc0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929385:0:23784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0bc0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929390:0:23784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4e00 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869885.929392:0:23784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0bc0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929396:0:23784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0bc0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929411:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8e2803eb5500) 00010000:00010000:0.0:1788869885.929414:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869885.929417:0:23784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0bc0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929422:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4e00/0x4c16c38a9b6d0bc0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929437:0:23784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6d0bc7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929443:0:23784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6d0bc7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929448:0:23784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6d0bc7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929453:0:23784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e282dbb4000 already unused, calling callback (ffffffffc19434f0) 00010000:00010000:0.0:1788869885.929455:0:23784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6d0bc7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929460:0:23784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6d0bc7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929465:0:23784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8e2803b9b300) 00010000:00010000:0.0:1788869885.929467:0:23784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788869885.929470:0:23784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6d0bc7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788869885.929475:0:23784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e282dbb4000/0x4c16c38a9b6d0bc7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788869885.929574:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96d468b1-a138-4403-9587-850a7665da93+24:18882:x1875765305195904:12345-192.168.204.54@tcp:34:lfs.0 Request processed in 664us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869885.929582:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:2.0:1788869885.931756:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869885.931800:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305196160 00000100:00100000:0.0:1788869885.931811:0:22668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305196160 00000100:00100000:0.0:1788869885.931917:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:0.0:1788869885.931927:0:22668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96d468b1-a138-4403-9587-850a7665da93+24:18882:x1875765305196160:12345-192.168.204.54@tcp:35:lfs.0 00000100:00100000:0.0:1788869885.932401:0:22668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96d468b1-a138-4403-9587-850a7665da93+25:18882:x1875765305196160:12345-192.168.204.54@tcp:35:lfs.0 Request processed in 475us (652us total) trans 12884901930 rc 0/0 00000100:00100000:0.0:1788869885.932410:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 15 00000100:00100000:2.0:1788869886.393618:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869886.393665:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869886.393705:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869886.393753:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869886.393773:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869886.393792:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:2.0:1788869886.393815:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:3.0:1788869886.393900:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305196544 00000100:00100000:3.0:1788869886.393912:0:24174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305196544 00000100:00100000:3.0:1788869886.393979:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305197056 00000100:00100000:3.0:1788869886.393983:0:24174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305197056 00000100:00100000:3.0:1788869886.393994:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305196928 00000100:00100000:3.0:1788869886.393996:0:24174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305196928 00000100:00100000:3.0:1788869886.394011:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:3.0:1788869886.394020:0:24174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817952d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96d468b1-a138-4403-9587-850a7665da93+5:2409:x1875765305196544:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869886.394107:0:24174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817952d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96d468b1-a138-4403-9587-850a7665da93+5:2409:x1875765305196544:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 87us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869886.394108:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305196288 00000100:00100000:0.0:1788869886.394112:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305196288 00000100:00100000:3.0:1788869886.394114:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 25 00000100:00100000:3.0:1788869886.394130:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:0.0:1788869886.394145:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 170 00000100:00100000:3.0:1788869886.394148:0:24174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:2409:x1875765305197056:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869886.394151:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:2409:x1875765305196288:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869886.394175:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d6460b5-31e2-4371-a5e1-fc7d3e14d226+13:2409:x1875765305196288:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 24us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869886.394186:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 170 00000100:00100000:0.0:1788869886.394217:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:1.0:1788869886.394221:0:24175:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788869886.394223:0:24176:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e27038e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:2409:x1875765305196928:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:1.0:1788869886.394230:0:24175:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00080000:2.0:1788869886.394279:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788869886.394283:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788869886.395042:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305196800 00000100:00100000:1.0:1788869886.395049:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305196800 00000100:00080000:1.0:1788869886.395074:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869886.395106:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305196416 00000100:00100000:1.0:1788869886.395110:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305196416 00000100:00080000:1.0:1788869886.395120:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788869886.395148:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305196672 00000100:00100000:1.0:1788869886.395151:0:22666:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305196672 00000100:00080000:1.0:1788869886.395164:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788869886.395181:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:1.0:1788869886.395189:0:22666:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2817950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:2409:x1875765305196800:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:3.0:1788869886.400703:0:24174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:2409:x1875765305197056:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 6539us (6933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869886.400721:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 26 00000100:00100000:3.0:1788869886.400893:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:3.0:1788869886.400908:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270402ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96d468b1-a138-4403-9587-850a7665da93+5:2409:x1875765305196416:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869886.403133:0:24176:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e27038e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:2409:x1875765305196928:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 8894us (9301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869886.403148:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 27 00000100:00100000:0.0:1788869886.403202:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:0.0:1788869886.403215:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:2409:x1875765305196672:12345-192.168.204.54@tcp:400:kworker.0 00000100:00100000:0.0:1788869886.403317:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e29a08ad-0316-4442-93c9-d46ea76b83fc+6:2409:x1875765305196672:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 98us (9514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869886.403330:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 75 00000100:00100000:3.0:1788869886.406342:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270402ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96d468b1-a138-4403-9587-850a7665da93+5:2409:x1875765305196416:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 5428us (12555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869886.406370:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 74 00000100:00100000:1.0:1788869886.413830:0:22666:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2817950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e29a08ad-0316-4442-93c9-d46ea76b83fc+5:2409:x1875765305196800:12345-192.168.204.54@tcp:400:kworker.0 Request processed in 18625us (20108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869886.413850:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 73 00000100:00100000:3.0:1788869886.792387:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2702928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325235968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788869886.792490:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869886.792657:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325235968 00000100:00100000:0.0:1788869886.792666:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325235968 00000100:00100000:0.0:1788869886.792721:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788869886.792731:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f059180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875765325235968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788869886.792770:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788869886.792839:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f059180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875765325235968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869886.792846:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788869886.792957:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2702928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325235968:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788869886.923023:0:22653:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788869887.813796:0:22700:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788869887.813807:0:22700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788869887.813827:0:22700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788869887.813836:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788869887.832631:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e270292a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325236096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788869887.832713:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788869887.832860:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325236096 00000100:00100000:0.0:1788869887.832871:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325236096 00000100:00100000:0.0:1788869887.832951:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788869887.832974:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325236096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788869887.833005:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788869887.833055:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325236096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869887.833062:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788869887.833110:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788869887.833329:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e270292a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325236096:0@lo:13:osp-pre-0-1.0 00000001:02000400:1.0:1788869887.901514:0:25753:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1788869887.943269:0:25255:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788869888.326094:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841fc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325236224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788869888.326179:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869888.326355:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325236224 00000100:00100000:1.0:1788869888.326363:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325236224 00000100:00100000:1.0:1788869888.326430:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788869888.326441:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841003480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325236224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788869888.326488:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788869888.326554:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841003480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875765325236224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869888.326561:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788869888.326624:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841fc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875765325236224:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788869888.326803:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869888.327208:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788869888.327221:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e282f05a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325236352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788869888.327263:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788869888.327364:0:24177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325236352 00000100:00100000:3.0:1788869888.327370:0:24177:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325236352 00000100:00100000:3.0:1788869888.327417:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788869888.327424:0:24177:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325236352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788869888.327438:0:24177:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788869888.327474:0:24177:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875765325236352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869888.327480:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788869888.327551:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788869888.327575:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e282f05a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875765325236352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788869888.328661:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841fc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325236864:0@lo:400:kworker.0 00000100:00100000:1.0:1788869888.328747:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869888.328779:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841fc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325237376:0@lo:400:kworker.0 00000100:00100000:1.0:1788869888.328804:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869888.328824:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788869888.328829:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841fc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325236736:0@lo:400:kworker.0 00000100:00100000:1.0:1788869888.328856:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869888.328871:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841fc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765325237248:0@lo:400:kworker.0 00000100:00100000:1.0:1788869888.328891:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869888.328905:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325237760:0@lo:400:kworker.0 00000100:00100000:1.0:1788869888.328922:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869888.328948:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325236864 00000100:00100000:1.0:1788869888.328955:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325236864 00000100:00100000:1.0:1788869888.328991:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325237376 00000100:00100000:1.0:1788869888.328993:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325237376 00000100:00100000:1.0:1788869888.329008:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325237248 00000100:00100000:1.0:1788869888.329010:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325237248 00000100:00100000:1.0:1788869888.329019:0:23784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325237760 00000100:00100000:1.0:1788869888.329021:0:23784:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325237760 00000100:00100000:1.0:1788869888.329035:0:23784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788869888.329042:0:23784:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325236864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869888.329154:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841fc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325236608:0@lo:400:kworker.0 00000100:00100000:2.0:1788869888.329184:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869888.329225:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841fc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325237120:0@lo:400:kworker.0 00000100:00100000:2.0:1788869888.329243:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869888.329256:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841fc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875765325237632:0@lo:400:kworker.0 00000100:00100000:2.0:1788869888.329271:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869888.329282:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788869888.329286:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841fc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3649:1875765325236480:0@lo:400:kworker.0 00000100:00100000:2.0:1788869888.329308:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869888.329342:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841fc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325236992:0@lo:400:kworker.0 00000100:00100000:2.0:1788869888.329360:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869888.329384:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e2841fc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765325237504:0@lo:400:kworker.0 00000100:00100000:2.0:1788869888.329401:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869888.329421:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325236608 00000100:00100000:2.0:1788869888.329424:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325236608 00000100:00100000:2.0:1788869888.329447:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325236992 00000100:00100000:2.0:1788869888.329449:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325236992 00000100:00100000:2.0:1788869888.329459:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788869888.329464:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325236608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869888.329522:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875765325236608:12345-0@lo:400:kworker.0 Request processed in 57us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869888.329529:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788869888.329543:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788869888.329548:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325236992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869888.329572:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325236992:12345-0@lo:400:kworker.0 Request processed in 25us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869888.329577:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788869888.329608:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325236480 00000100:00100000:2.0:1788869888.329611:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325236480 00000100:00100000:2.0:1788869888.329630:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788869888.329636:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2805e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:3649:x1875765325236480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788869888.329664:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2805e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c082ff99-6a3f-4428-a6f2-973bbd93c10a+24:3649:x1875765325236480:12345-0@lo:400:kworker.0 Request processed in 28us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869888.329670:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:2.0:1788869888.329697:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869888.329700:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788869888.329723:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841fc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c082ff99-6a3f-4428-a6f2-973bbd93c10a:3649:1875765325236480:0@lo:400:kworker.0 00000100:00100000:2.0:1788869888.329734:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841fc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325236992:0@lo:400:kworker.0 00000100:00100000:2.0:1788869888.329752:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841fc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875765325236608:0@lo:400:kworker.0 00000100:00100000:3.0:1788869888.329929:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325236736 00000100:00100000:3.0:1788869888.329934:0:24174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325236736 00000100:00100000:3.0:1788869888.329973:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325237120 00000100:00100000:3.0:1788869888.329976:0:24174:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325237120 00000100:00100000:3.0:1788869888.329993:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788869888.329999:0:24174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3651:x1875765325236736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869888.330042:0:24174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3651:x1875765325236736:12345-0@lo:400:kworker.0 Request processed in 44us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869888.330048:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788869888.330074:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788869888.330081:0:24174:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325237120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869888.330112:0:24174:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875765325237120:12345-0@lo:400:kworker.0 Request processed in 33us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869888.330117:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788869888.330132:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325237632 00000100:00100000:3.0:1788869888.330142:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325237632 00000100:00100000:3.0:1788869888.330161:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325237504 00000100:00100000:3.0:1788869888.330163:0:22665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325237504 00000100:00100000:3.0:1788869888.330175:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788869888.330180:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325237376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869888.330220:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875765325237376:12345-0@lo:400:kworker.0 Request processed in 39us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869888.330226:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788869888.330239:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788869888.330245:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765325237248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869888.330268:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875765325237248:12345-0@lo:400:kworker.0 Request processed in 24us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869888.330273:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788869888.330290:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788869888.330295:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325237760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869888.330320:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875765325237760:12345-0@lo:400:kworker.0 Request processed in 25us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869888.330324:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788869888.330457:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788869888.330464:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875765325237632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869888.330491:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875765325237632:12345-0@lo:400:kworker.0 Request processed in 29us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869888.330497:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788869888.330520:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788869888.330525:0:22665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e283b470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875765325237504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788869888.330551:0:22665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e283b470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875765325237504:12345-0@lo:400:kworker.0 Request processed in 26us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788869888.330562:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788869888.330821:0:23784:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875765325236864:12345-0@lo:400:kworker.0 Request processed in 1779us (2075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869888.330828:0:23784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788869888.330878:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841fc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875765325236736:0@lo:400:kworker.0 00000100:00100000:1.0:1788869888.330888:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841fc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875765325237248:0@lo:400:kworker.0 00010000:00080000:1.0:1788869888.330901:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2841fc5c00 x1875765325237760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788869888.330912:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875765325237760:0@lo:400:kworker.0 00000100:00100000:1.0:1788869888.330922:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841fc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875765325236864:0@lo:400:kworker.0 00000100:00100000:1.0:1788869888.330933:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841fc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875765325237376:0@lo:400:kworker.0 00000100:00080000:2.0:1788869888.331023:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788869888.331028:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788869888.331031:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788869888.331051:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8e2841fc6680 x1875765325237504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788869904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788869888.331071:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841fc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875765325237504:0@lo:400:kworker.0 00000100:00100000:2.0:1788869888.331083:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841fc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875765325237120:0@lo:400:kworker.0 00000100:00100000:2.0:1788869888.331092:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e2841fc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875765325237632:0@lo:400:kworker.0 00000100:00100000:1.0:1788869888.838208:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325237888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788869888.838337:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788869888.838919:0:23407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325237888 00000100:00100000:2.0:1788869888.838935:0:23407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325237888 00000100:00100000:2.0:1788869888.839029:0:23407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788869888.839042:0:23407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2841aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325237888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788869888.839107:0:23407:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788869888.839219:0:23407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2841aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875765325237888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 182us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788869888.839227:0:23407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788869888.839299:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875765325237888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788869888.840030:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e283b472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325238016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788869888.840104:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788869888.840240:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765325238016 00000100:00100000:1.0:1788869888.840249:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765325238016 00000100:00100000:1.0:1788869888.840305:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788869888.840315:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e270292b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325238016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788869888.840363:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788869888.840423:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e270292b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875765325238016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788869888.840431:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788869888.840695:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e283b472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875765325238016:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788869888.971653:0:22652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788869889.466500:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869889.466626:0:25715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305197312 00000100:00100000:0.0:1788869889.466641:0:25715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305197312 00000100:00100000:0.0:1788869889.466725:0:25715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00100000:0.0:1788869889.466760:0:25715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e282f05a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96d468b1-a138-4403-9587-850a7665da93+8:2407:x1875765305197312:12345-192.168.204.54@tcp:16:kworker.0 00000100:00100000:0.0:1788869889.466898:0:25715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e282f05a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96d468b1-a138-4403-9587-850a7665da93+8:2407:x1875765305197312:12345-192.168.204.54@tcp:16:kworker.0 Request processed in 142us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788869889.466905:0:25715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 33 00000100:00080000:1.0:1788869889.468621:0:22660:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788869889.470323:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.54@tcp (source: 12345-192.168.204.54@tcp) 00000100:00100000:0.0:1788869889.470443:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875765305197184 00000100:00100000:0.0:1788869889.470455:0:24179:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875765305197184 00002000:00100000:0.0:1788869889.470529:0:24179:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff8e2703a8f100 x1875765305197184/t0(0) o4->96d468b1-a138-4403-9587-850a7665da93@192.168.204.54@tcp:80/0 lens 504/0 e 0 to 0 dl 1788869900 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788869889.470541:0:24179:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2703a8f100 with x1875765305197184 ext(0->8) 00002000:00010000:0.0:1788869889.470548:0:24179:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2703a8f100 00000100:00100000:0.0:1788869889.470615:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.54@tcp, seq: 0 00000100:00100000:0.0:1788869889.470628:0:24179:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e2703a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96d468b1-a138-4403-9587-850a7665da93+8:2408:x1875765305197184:12345-192.168.204.54@tcp:4:bash.0 00000100:00100000:0.0:1788869889.472405:0:24179:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e2703a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96d468b1-a138-4403-9587-850a7665da93+10:2408:x1875765305197184:12345-192.168.204.54@tcp:4:bash.0 Request processed in 1769us (2081us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788869889.472418:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.54@tcp, seq: 0 00002000:00100000:0.0:1788869889.472432:0:24179:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff8e2703a8f100 x1875765305197184/t12884901895(0) o4->96d468b1-a138-4403-9587-850a7665da93@192.168.204.54@tcp:80/0 lens 504/448 e 0 to 0 dl 1788869900 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788869889.472443:0:24179:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e2703a8f100 with x1875765305197184 ext(0->8) 00002000:00010000:0.0:1788869889.472450:0:24179:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e2703a8f100 Debug log: 15044 lines, 15044 kept, 0 dropped, 0 bad.